-- Logs begin at Tue 2022-08-23 04:48:02 UTC, end at Tue 2022-08-23 06:28:51 UTC. -- Aug 23 05:43:50.028016 dv-cinder-853788-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 05:43:50.036501 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 05:43:50 2022] *** Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: nodename: dv-cinder-853788-2-iscsi Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: machine: x86_64 Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: clock source: unix Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: pcre jit disabled Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: detected number of CPU cores: 4 Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: current working directory: / Aug 23 05:43:50.038504 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: detected binary path: /usr/bin/uwsgi-core Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: your processes number limit is 47680 Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: your memory page size is 4096 bytes Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: detected max file descriptor number: 2048 Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: lock engine: pthread robust mutexes Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: thunder lock: enabled Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 05:43:50.039128 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 05:43:50.083434 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: Python main interpreter initialized at 0x559b98a7f9c0 Aug 23 05:43:50.083434 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: python threads support enabled Aug 23 05:43:50.083434 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: your server socket listen backlog is limited to 100 connections Aug 23 05:43:50.083434 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: your mercy for graceful operations on workers is 90 seconds Aug 23 05:43:50.083773 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 05:43:50.083850 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: *** Operational MODE: preforking *** Aug 23 05:43:50.084109 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: *** uWSGI is running in multiple interpreter mode *** Aug 23 05:43:50.084109 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: spawned uWSGI master process (pid: 80409) Aug 23 05:43:50.084303 dv-cinder-853788-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 23 05:43:50.086462 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: spawned uWSGI worker 1 (pid: 80422, cores: 1) Aug 23 05:43:50.086462 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: spawned uWSGI worker 2 (pid: 80423, cores: 1) Aug 23 05:43:50.086462 dv-cinder-853788-2-iscsi devstack@keystone.service[80409]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 05:43:55.878252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 05:43:55.878252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Aug 23 05:43:55.879045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 05:43:55.879045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: from cryptography.utils import int_from_bytes Aug 23 05:43:55.884522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 05:43:55.884522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: from cryptography.utils import int_from_bytes Aug 23 05:43:55.884985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 05:43:55.884985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: from cryptography.utils import int_from_bytes Aug 23 05:43:55.924310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 05:43:55.924504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 05:43:55.924697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] command line args: [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 05:43:55.924968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 05:43:55.925146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ================================================================================ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 05:43:55.925402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.925683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_dir = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.925871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.926053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] config_source = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.926230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] debug = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.926427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_config_append = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.927996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.928174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_dir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.928352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.928586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.928832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.929076 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.929324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.929524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.929704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.929947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.930160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 05:43:55.930263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.930345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 05:43:55.930427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.930575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] command line args: [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 05:43:55.930706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.930956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 05:43:55.931148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.931326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ================================================================================ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 05:43:55.931512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.931697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] admin_token = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.931914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] config_dir = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] config_source = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] debug = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.932942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] publish_errors = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.933991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_config_append = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] standard_threads = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_dir = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.934928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_journal = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_json = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_stderr = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] use_syslog = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.935965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.936824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.936901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.937055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.937132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.937292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.937483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.937569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.937796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.937883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.937992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] publish_errors = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.938082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.938231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.938339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.938488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.938584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.938672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.938746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.938871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.939017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.939142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.939265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.939391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] standard_threads = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.939508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.939630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.939747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.939863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.939986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.940111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.940238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.940362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] use_journal = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.940362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] use_json = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.940593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.940715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] use_stderr = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.940843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.940966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] use_syslog = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.941083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 05:43:55.941327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.941985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.942825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.943996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.944955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.945812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.946970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.947100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.947207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.947317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.947429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.948994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.949894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.950977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.951925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.952885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.953877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.954987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.955817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.956983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.957882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.958940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.959996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.960965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.external = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.961940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.password = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] auth.token = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.962898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.963017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.963134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.963904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.964892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.965913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.966999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.967955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.external = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.968927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.password = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.token = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.969912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.970950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.971910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.972983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.973985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.974962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.975958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.976916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.977922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.978998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.979952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.980912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.981890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.982862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.983972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.984888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.985961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.986953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.987912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.988974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.989897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.990963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.991930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.992882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.993803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.994022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.994022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.994240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.994920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.995993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.996939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.997885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.998949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:55.999902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.000953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.001921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.002889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] role.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] role.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.003948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.004942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.005956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.006883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.007961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.008906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.009949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.010130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.010737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.010855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.010977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.011928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.012998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.013978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.014325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.015308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.016300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.017261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 05:43:56.017261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 05:43:56.040310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.040538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.040766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.042004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.042241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.042472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.049355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.051206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.078561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.078788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.080356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.080585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.132550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.133055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.181627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.181859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.184958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.185258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.248766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.248937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.249972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.250091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.275847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.275969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.276853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.277067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.277151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.277286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.277379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.288346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.288739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.300876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.301962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.302048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.302172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.302253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.302385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.302602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 05:43:56.319544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.319754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 05:43:56.320087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.320170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.320286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 05:43:56.320385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 05:43:56.320557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.320669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.320815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.320899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 05:43:56.321069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.321154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.321318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.321428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.321720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.321977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.332494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.332769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.333035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.333313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.333397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.333618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.333891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.334174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.341745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.342728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.344956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.345233 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.345533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.345824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.345991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.346104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.346271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.346356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.346552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.346637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.346837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.347902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.348176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.348449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.348718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.374176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.375447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.375756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.376034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.377040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.377321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.381343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.381645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.381922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.382713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.382949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.383224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.389721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.390023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.390978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.391259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.394392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.394676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.394955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.395236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.395509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.395679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.395763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.395966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.396049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.396249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.396334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.396532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.396806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.397079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.397348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.397641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.414862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.415137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.416174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.416977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.420193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.421565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.423857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.424149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.425249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.425571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.429102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.430574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.433231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.434720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.436857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.437152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.437460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.437739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.438016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.438292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.438372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.438624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.438914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.439205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.439483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.439774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.457109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.457387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.457676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.457937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.458769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.459055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.459323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.459587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.466089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.467660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.467940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.468213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.469466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.469749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.471234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.471521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.471810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.472098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.472374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.472763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.473052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.473340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.473665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.473945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.487236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.487520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.487800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.488081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.488362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.488649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.488922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.490129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.490422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.490710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.490992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.491272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.491561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.491836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.507119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.510157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.510350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.513422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.615185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.616782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.617808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.618405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.618690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.618982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.620022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.621649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.621929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.622212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.626939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.628521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.629449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.631049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.631873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.632159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.632440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.632758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.634428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.634718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.635029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.635309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.641730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.642013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.642291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.644361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.644652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.644933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.650185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.650464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.650767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.651038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.651303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.651568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.651850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.652122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.652385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.652648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.652867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 05:43:56.652968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.653980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.654251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.654538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.654805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.655071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.655337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.655610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.655871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.656149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.656416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 05:43:56.691891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b98a7f9c0 pid: 80423 (default app) Aug 23 05:43:56.695048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b98a7f9c0 pid: 80422 (default app) Aug 23 05:43:56.695142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8744-bc84-489b-8040-e30283df7956 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:43:56.695400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8744-bc84-489b-8040-e30283df7956 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:43:56.695672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8744-bc84-489b-8040-e30283df7956 None None] PATH_INFO: `/v3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:43:56.699866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Tue Aug 23 05:43:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:05.919684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:05.920219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:05.920219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:05.925333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:05.930746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:05.931139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:05.931289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:05.961301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG oslo_db.sqlalchemy.engines [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 05:44:06.144179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80423) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 05:44:06.144606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG passlib.handlers.bcrypt [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80423) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 05:44:06.200699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:06.202253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:06.320294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 05:44:06.474082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:06.507375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG oslo_db.sqlalchemy.engines [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 05:44:06.633947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181034d-070e-4e92-884e-242396aad3e1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:06.638844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:06.639503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:06.639791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:06.640069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:06.647964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:06.698292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 05:44:06.698630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f4d0e-7923-4658-bdf0-1ebea3aba8eb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:06.707870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Aug 23 05:44:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 05:44:06.714265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:06.728751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263d51e-0b0c-4fb1-83e8-023d90e918f9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:06.733710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:06.734800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:06.735080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:06.735351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] PATH_INFO: `/v3/projects/3869decee235490cb9b23376a9ec23ec` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:06.736835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] RBAC: Authorizing `identity:get_project(project_id=3869decee235490cb9b23376a9ec23ec)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:06.788964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 05:44:06.789300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22342b-5d64-4aec-a106-28b656b3a95f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:06.794475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Tue Aug 23 05:44:06 2022] GET /identity/v3/projects/3869decee235490cb9b23376a9ec23ec => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:09.100800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410301-f8ab-4050-a87c-231b737e28ae None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:09.101375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410301-f8ab-4050-a87c-231b737e28ae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:09.101375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410301-f8ab-4050-a87c-231b737e28ae None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:09.105863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:09.111246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:09.111650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:09.111805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:09.130266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:09.131805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:09.140068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 05:44:09.162199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410301-f8ab-4050-a87c-231b737e28ae None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:09.173773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410301-f8ab-4050-a87c-231b737e28ae None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:09.177863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:09.178475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:09.178754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:09.179026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:09.186368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:09.188135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b710a51-c350-43dc-a393-97e1482f5bc2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:09.196450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Aug 23 05:44:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 05:44:09.202253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:09.211130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a876c-9823-43c9-a4a4-8a602bb9755b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:09.215938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:09.216776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:09.217056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:09.217331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:09.218762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:09.220586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902560b-1e47-4751-b8e2-d58877344207 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:09.222151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Tue Aug 23 05:44:09 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:11.577627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a5ba-db25-4af1-b2b7-2dca149dc8e7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.578152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a5ba-db25-4af1-b2b7-2dca149dc8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.578234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a5ba-db25-4af1-b2b7-2dca149dc8e7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.579945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:11.585344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.585770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.585935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.602929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:11.604105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:11.622994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060797d4-e567-4845-aac4-d8feea23a6f3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.623276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060797d4-e567-4845-aac4-d8feea23a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.623553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060797d4-e567-4845-aac4-d8feea23a6f3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.625286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:11.630258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.630547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.630825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.671432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG passlib.handlers.bcrypt [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80422) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 05:44:11.671765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG passlib.handlers.bcrypt [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80422) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 05:44:11.680909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:11.704934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:11.718938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:11.720500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:11.797884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe667e-d373-4879-9482-73f8a3b88bae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:11.814064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:11.830356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:11.831141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.831422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.831695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.836515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:11.842776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:11.849683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:11.851091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:44:11.856544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:11.929568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65c64-d136-42ec-8c07-6027420df75f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:11.947848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7875e2-a67b-4a47-9ffe-8873f7239d80 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:11.961950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:11.962836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.963116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.963390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.980730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:11.981370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:11.981679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:11.981948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:11.982686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:11.982987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:11.984359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:11.995534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:12.000937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:12.028051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.029621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.093452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8bd9c-4094-458b-8c89-705ad7751d59 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:12.121255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:44:12.125008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:12.125901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:12.126208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:12.126482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:12.127695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.127796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:12.129179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.130789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:12 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:12.135891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:12.218145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b32a6-1b89-4dcb-885d-8295b072e919 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:12.227503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513da3b5-5f03-4802-b2ad-aeaeca49e089 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:12.250445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:12.251229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:12.251512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:12.251786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:12.259035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:12.259797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:12.260074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:12.260344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:12.261590 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.263035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.264600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:12.270048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.270175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:12.271511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.287876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:44:12.289059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:44:12.295077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:12.363825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e8139-795f-4b43-a2b4-d9ceb389a79f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:12.388435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf909d1-3d5e-410a-8926-be99eecb84ba None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:12.395563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:12.396376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:12.396658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:12.396932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:12.397793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.domain.id=default, user.id=bc9a8d70ef924eccb0a2efd6a32909f6) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:12.398101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.399569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdc251-5d8a-40b5-901a-7f03cf489e6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.406173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Aug 23 05:44:12 2022] GET /identity/v3/role_assignments?user.id=bc9a8d70ef924eccb0a2efd6a32909f6&scope.domain.id=default&role.id=0b140cf23eea4013a92d34840813e9cf => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:12.421207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:12.421904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:12.422187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:12.422464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:12.423204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:12.423511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:12.425152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286444d-c2dc-403c-a13e-9d95292fef9a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:12.445961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:15.212003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301e16-513a-4e9b-8dfa-46a5b9ff53b2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.213010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301e16-513a-4e9b-8dfa-46a5b9ff53b2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.214098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5301e16-513a-4e9b-8dfa-46a5b9ff53b2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.216659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:15.221676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166d2fe-f6c6-4f2d-90af-a4fd09898835 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.222078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166d2fe-f6c6-4f2d-90af-a4fd09898835 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.222242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166d2fe-f6c6-4f2d-90af-a4fd09898835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.246409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e166d2fe-f6c6-4f2d-90af-a4fd09898835 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:15.247808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e166d2fe-f6c6-4f2d-90af-a4fd09898835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:15.338249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:15.379749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5301e16-513a-4e9b-8dfa-46a5b9ff53b2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:15.522937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5301e16-513a-4e9b-8dfa-46a5b9ff53b2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:15.568760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:15.569465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.569754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.570034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.570806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:15.571599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff269ab-7ddc-4b15-8833-5693aea5a3c3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.572089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff269ab-7ddc-4b15-8833-5693aea5a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.572286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:15.572755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff269ab-7ddc-4b15-8833-5693aea5a3c3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.575826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:15.591132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85531-0f67-44ff-875e-dc5527efca6f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.591731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85531-0f67-44ff-875e-dc5527efca6f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.592200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b85531-0f67-44ff-875e-dc5527efca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.614553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-43b85531-0f67-44ff-875e-dc5527efca6f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:15.616093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-43b85531-0f67-44ff-875e-dc5527efca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:15.686050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:15.687822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c7055-0ff3-414b-b2fd-75d9224f2aed None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.688288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c7055-0ff3-414b-b2fd-75d9224f2aed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.688759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c7055-0ff3-414b-b2fd-75d9224f2aed None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.690881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:15.696636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:15.697124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:15.697674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:15.734483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:15.735692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:15.817289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 13/27] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Aug 23 05:44:15 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:15.818656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:15.865412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:15.906751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:15.973624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef021fd-d3d4-410d-915f-597ba14b1723 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.055217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.056050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.056336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.056614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.061867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951415e-d52f-46b8-8bd0-5d4104473589 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.086622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:16.100292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-a98e5570-ccec-4a2a-8b97-802305001f9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:16.100472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.100472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.100702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.101184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.102115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:16.103537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad12-7077-49aa-88d3-58227390073b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.104882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad12-7077-49aa-88d3-58227390073b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.105180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4ad12-7077-49aa-88d3-58227390073b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.107220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:16.112342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.112634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.112928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.114947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.116782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.135471 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:44:16.137003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:16.137483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:16.138317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.141771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:16.221648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:16.222557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.256989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd823a-3f90-4994-98c1-7490fc3779d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.302631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.303538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.303960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.304363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.305259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:16.305752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.307344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.320892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:16.322043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.348595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44680-ce1c-44f6-8cc6-88825d1ad310 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.389470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.389470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.389470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.389470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.389796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:16.389796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.389796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.406966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 17/34] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:16.412337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.434008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4e40-3c8d-4ed6-90d5-a36b2be6e3f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.468782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.469472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.469915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.470334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.471268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.472874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.519205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef981-80fc-4af8-9867-bc950489cebc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.552878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.553790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.554077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.554372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.555631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.557125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.558777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:16 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:16.559517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.675617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b5f0-66b0-4193-9826-9df06f88cf9b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.717474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Aug 23 05:44:16 2022] POST /identity/v3/roles => generated 225 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:16.717676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.717881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.717969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.717969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.717969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.717969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.717969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e24df-715e-49d5-8b35-523df4b05861 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.810318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:44:16 2022] POST /identity/v3/projects => generated 301 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:16.811818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0ee6-846e-4c2f-bfe7-007f0a568a91 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.812183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0ee6-846e-4c2f-bfe7-007f0a568a91 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.812538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0ee6-846e-4c2f-bfe7-007f0a568a91 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.814691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:16.820853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1cbb-ac2c-4a56-89ac-0642011510a3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.821249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1cbb-ac2c-4a56-89ac-0642011510a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.821660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1cbb-ac2c-4a56-89ac-0642011510a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.848397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-625f1cbb-ac2c-4a56-89ac-0642011510a3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:16.850005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-625f1cbb-ac2c-4a56-89ac-0642011510a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:16.853061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700a98-d8f3-4839-b13a-44172186c280 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:16.895283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:16.896460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.896892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.897309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.899311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:16.901370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6b755-2fba-4e64-8fbe-23cabf9631cc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:16.903681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 19/39] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:16.905330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14029-83d8-4eb6-890b-c3c6756c9eb9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.905792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14029-83d8-4eb6-890b-c3c6756c9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.906231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a14029-83d8-4eb6-890b-c3c6756c9eb9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.909321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 20/40] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:16.914630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a14029-83d8-4eb6-890b-c3c6756c9eb9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:16.949860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:16.951252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:16.951551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:16.951832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:16.970268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:16.971483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:17.046453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a14029-83d8-4eb6-890b-c3c6756c9eb9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:17.058079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:17.058996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:17.091488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:17.092704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:17.092985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:17.093270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] PATH_INFO: `/v3/domains/default/users/bc9a8d70ef924eccb0a2efd6a32909f6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:17.095699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bc9a8d70ef924eccb0a2efd6a32909f6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:17.097170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:17.157657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142711-b14e-475c-afb2-3c2e50a9c59c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:17.168013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1361 bytes} [Tue Aug 23 05:44:16 2022] PUT /identity/v3/domains/default/users/bc9a8d70ef924eccb0a2efd6a32909f6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:17.168843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:17.192610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:17.193326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:17.193638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:17.193912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:17.194688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:17.196202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:17.260531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Aug 23 05:44:17 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:17.274757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5396c0-590e-421a-8085-a3a10eafa9d7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:17.314967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:17.315785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:17.316059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:17.316392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:17.317726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:17.319264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808480-17c8-473b-b6b8-a505f00f54bd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:17.321349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:17.327656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:17.438799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ca4ea-042a-4b77-bde8-4b98371f25ab None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:17.473705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3207e-2203-497e-9460-b94541460033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:17.474428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3207e-2203-497e-9460-b94541460033 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:17.474720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3207e-2203-497e-9460-b94541460033 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:17.475001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3207e-2203-497e-9460-b94541460033 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:17.475747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3207e-2203-497e-9460-b94541460033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:17.477230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3207e-2203-497e-9460-b94541460033 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:17.593037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:44:17 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:19.491088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7434-4183-49e2-84f2-097d21df322d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.491594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7434-4183-49e2-84f2-097d21df322d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.491704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7434-4183-49e2-84f2-097d21df322d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.493404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:19.499099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.499497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.499655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.517381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:19.518574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:19.583810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:19.606913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf7434-4183-49e2-84f2-097d21df322d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:19.700944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf7434-4183-49e2-84f2-097d21df322d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:19.732979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:19.733809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.734098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.734381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.745835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:19.752731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:19.753955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:19.759850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:19.851488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafb79-8c83-4e85-ad75-1d4ab8864452 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:19.883154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:19.883807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.884089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.884361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.885679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:19.885985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:19.887378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc868-d1ed-4c82-be1c-42c508049740 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:19.895034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:19.901140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:19.905276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e74b-2754-419d-aa93-fc8c54c930d8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.905605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e74b-2754-419d-aa93-fc8c54c930d8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.905894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10e74b-2754-419d-aa93-fc8c54c930d8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.907628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 27/51] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:19.912456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:19.912747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:19.913030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:19.929078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:19.930274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:19.992747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:19.995927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a3c1a-9e4d-4483-922e-1bddf9cc6d49 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:20.016981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:20.027817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:20.028688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:20.028971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:20.029248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:20.030466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:20.031924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:20.033564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:19 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:20.038903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:20.108575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8a288-cdb8-451b-8077-55438854a20e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:20.131860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113df10-5a70-4c00-b1b3-1a8b9b44ee0c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:20.140699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:20.141503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:20.141785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:20.142052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:20.143220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:20.144655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:20.146267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:20.151987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:20.164141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:20.164920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:20.165203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:20.165503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:20.166708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:20.168154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:20.169773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:20.175419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:20.245510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791605d-b9dc-4fa2-92da-6442d9aabf31 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:20.267109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e951d52-e721-489b-8b88-997bdbc51d0c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:20.277313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:20.277986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:20.278275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:20.278551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:20.279254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:20.280719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc65ec-89a7-4c99-a8c1-f722cf0025e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:20.299607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:20.300250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:20.300533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:20.300811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:20.301691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.domain.id=default, user.id=bc9a8d70ef924eccb0a2efd6a32909f6) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:20.302005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:20.303478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e59bc-4f66-4680-aa5b-32666447223a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:20.311293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Aug 23 05:44:20 2022] GET /identity/v3/role_assignments?user.id=bc9a8d70ef924eccb0a2efd6a32909f6&scope.domain.id=default&role.id=0b140cf23eea4013a92d34840813e9cf => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:20.364088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 30/57] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Aug 23 05:44:20 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:44:22.682291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3979dc-1c0c-4dde-977e-1a106f19643f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:22.682772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3979dc-1c0c-4dde-977e-1a106f19643f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:22.682772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3979dc-1c0c-4dde-977e-1a106f19643f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:22.684531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:22.689579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:22.689960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:22.690145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:22.706558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:22.707726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:22.769351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:22.793523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3979dc-1c0c-4dde-977e-1a106f19643f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:22.889459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3979dc-1c0c-4dde-977e-1a106f19643f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:22.920481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:22.921246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:22.921556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:22.921834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:22.922984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:22.924434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776244c-424b-42d1-a6cb-780341525082 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:22.926037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:22.932451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:23.026432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc46c-fb78-49b3-b988-f4638a96a665 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:23.058148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:23.058796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:23.059079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:23.059354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:23.060050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:23.061523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe985-c110-408f-b78a-aba4a77d3dbd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:23.161129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:22 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:26.333686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5af4-110b-4a85-85f8-f44a4d2c8224 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.334228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5af4-110b-4a85-85f8-f44a4d2c8224 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.334308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5af4-110b-4a85-85f8-f44a4d2c8224 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.336341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:26.341312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.341768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.341894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.366425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:26.367905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:26.460308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:26.494074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5af4-110b-4a85-85f8-f44a4d2c8224 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:26.636815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5af4-110b-4a85-85f8-f44a4d2c8224 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:26.691499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17797601-b154-4652-859d-70aafdff1278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:26.692374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17797601-b154-4652-859d-70aafdff1278 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.692666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17797601-b154-4652-859d-70aafdff1278 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.692951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17797601-b154-4652-859d-70aafdff1278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.710486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17797601-b154-4652-859d-70aafdff1278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:26.718155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-17797601-b154-4652-859d-70aafdff1278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:26.719671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 31/64] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:26.725187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:26.866879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204125be-4b2f-4c4d-9b5d-8add839b03e9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:26.911258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:26.912175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.912608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.913039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.913979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:26.914437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:26.916650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451bd9f-6878-4282-8a34-b884b0e4c2c1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:26.928255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 34/65] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:26.933989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17797601-b154-4652-859d-70aafdff1278 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:26.955416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932601-49ae-450c-91a6-1f2b5286f549 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.955921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932601-49ae-450c-91a6-1f2b5286f549 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.956358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932601-49ae-450c-91a6-1f2b5286f549 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.958573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 35/66] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:26.965939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72939da-e9b1-43d4-8fc9-699d391a0a9a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:26.966462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72939da-e9b1-43d4-8fc9-699d391a0a9a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:26.966889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72939da-e9b1-43d4-8fc9-699d391a0a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:26.994105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b72939da-e9b1-43d4-8fc9-699d391a0a9a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:26.995339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b72939da-e9b1-43d4-8fc9-699d391a0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:27.058443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17797601-b154-4652-859d-70aafdff1278 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.081394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 36/67] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:27.083406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c43-2f21-4bb8-8858-ffcd0ae45ddc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.083864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c43-2f21-4bb8-8858-ffcd0ae45ddc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.084344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c43-2f21-4bb8-8858-ffcd0ae45ddc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.086500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 37/68] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:27.092913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.093385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.093835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.111753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:27.113222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:27.118161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.119247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.119686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.120107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.137399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.139574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.143143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 32/69] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:26 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.148207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.197148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 38/70] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:27.198839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.245641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bacdd-e6b0-4408-a225-19f392809785 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.280369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.281186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.281491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.281778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.292143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:27.299387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-3410636c-0e48-446c-ac8c-64cc77a50331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 33/71] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4176bd-fdd2-4df3-a000-2e5dc3e2b385 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4176bd-fdd2-4df3-a000-2e5dc3e2b385 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4176bd-fdd2-4df3-a000-2e5dc3e2b385 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 34/72] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:27.305191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4176bd-fdd2-4df3-a000-2e5dc3e2b385 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.310053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfae13-9ffd-4245-b03d-83b04fe8cf8a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.345184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.345964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.346246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.346532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.407542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4176bd-fdd2-4df3-a000-2e5dc3e2b385 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.415508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.416985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51dde6-cc5c-4b8c-a6cf-0bd644446f67 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.439592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.440382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.440664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.440939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.451521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:27.458600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:27.459781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 35/73] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:27.460557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.508386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 39/74] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:27.510225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b4aa8-8070-465c-82eb-9e706a7faea0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.510511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b4aa8-8070-465c-82eb-9e706a7faea0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.510793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b4aa8-8070-465c-82eb-9e706a7faea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.527664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e07b4aa8-8070-465c-82eb-9e706a7faea0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:27.528829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e07b4aa8-8070-465c-82eb-9e706a7faea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:27.554287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b50b0-0b31-434c-86fa-60a20d40f2ce None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.586401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.587113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.587399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.587676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.588414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:27.588720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.590121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.591061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:27.601689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667452f2-d437-4a9d-854d-03b7f1b19766 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.601689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667452f2-d437-4a9d-854d-03b7f1b19766 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.601689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667452f2-d437-4a9d-854d-03b7f1b19766 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.601689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 41/76] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:27.601689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667452f2-d437-4a9d-854d-03b7f1b19766 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.606419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 36/77] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.606419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.694055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667452f2-d437-4a9d-854d-03b7f1b19766 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.697676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971848-060f-4625-8db0-bf67bcef670e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.725898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.726550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.726834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.727114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.727890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:27.728195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.728863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.729605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.729757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.730045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.730324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.731532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.732942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100653da-5035-43c9-ad43-fcbe7b0b2768 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.734645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 37/78] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.735839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.736132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.736413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.741877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.741877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.756857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:27.758390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:27.820188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:27.821045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.835365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9584-ee57-464c-b009-0ae7b1a47c78 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.867319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.868792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.869096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.869372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.870600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.872051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.873703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 43/81] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.878169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.914028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211906c-dbf9-47bc-a274-5c0d4891b59f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:27.946391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:27.947174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:27.947458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:27.947741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:27.948912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:27.950395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:27.951993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:27.952754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:27.971555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20614e-6b4e-437d-950f-e757833b5955 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.003864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.004452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.004738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.005026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.005896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:28.006213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.007701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.012924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.012924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.049390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd043-f7cd-4411-b9dd-634ce033fa65 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.085965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.086941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.087221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.087499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.088800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.090327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.102901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 40/84] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:27 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.102901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.119638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d458bdf-6b8e-4bd0-9b9b-cbdd79140948 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.154109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.154922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.155207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.155484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.167186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:28.174454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:28.181429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 45/85] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:28.181429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.205473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a700ef-ac28-4423-aa92-66583bece0ac None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.240994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.241676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.241957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.242226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.281190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b082a5-90f8-428e-a293-4bc31297dd48 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.308137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.309648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.313842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.314516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.314806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.315089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.315804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.317271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.395881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 46/86] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:28 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:28.397544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.408235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:28.409138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.508663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df853a-ee2e-46ef-9d37-cac1552e61d8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.515409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0979-4f40-41d1-8d2f-f343001e24af None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.545952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.546979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.547472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.547967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.552147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.553304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.553766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.554189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.555091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:28.555604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.557182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.566327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 42/88] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.567419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.621206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.622948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.675840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34823f-24ef-4822-90ea-7364ffaf679a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.720301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.721177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.721530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.721820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.723050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.724521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.726302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 43/89] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.727205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.735458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 47/90] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:28.736410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.848806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b734dc-11fc-4614-bc68-043e3f6e8b52 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.848969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134aa6-cf01-4779-806c-e4c841edd062 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:28.889244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.890181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.890472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.890752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.891911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:28.892567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:28.892847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:28.893122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:28.893994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:28.894305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.896398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:28.897857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.898197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:28.903729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 44/91] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.906257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:28.914101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=ace62a47cba3428196ca1286882b1fae => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:28.915072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:29.050353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bbd1d-d3bc-462d-922a-0cf748f70153 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:29.095234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:29.095915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:29.096207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:29.096493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:29.111376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900763b-911d-4007-9534-a5e5596d1a6c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:29.178166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:29.179054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:29.179345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:29.179630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:29.181009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:29.184088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:29.189324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 45/93] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:29.191805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:29.209044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:29.212803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:29.396200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268bdd3-26d4-4252-bfc3-9dcdf96bfc9b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:29.408129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 49/94] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:29.415361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:29.465933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88110b04-295f-432c-9a70-514a31977518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:29.467266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110b04-295f-432c-9a70-514a31977518 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:29.467767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110b04-295f-432c-9a70-514a31977518 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:29.468238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110b04-295f-432c-9a70-514a31977518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:29.469294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88110b04-295f-432c-9a70-514a31977518 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=bc9a8d70ef924eccb0a2efd6a32909f6) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:29.469824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88110b04-295f-432c-9a70-514a31977518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:29.471492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88110b04-295f-432c-9a70-514a31977518 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:29.485617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 46/95] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:29 2022] GET /identity/v3/role_assignments?user.id=bc9a8d70ef924eccb0a2efd6a32909f6&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:29.532755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1d551-5f12-451a-999d-76b4336195c5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:29.573064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:29.573987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:29.574437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:29.574854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] PATH_INFO: `/v3/projects/27f57edf07f34b868c79396b818ec481` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:29.576265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] RBAC: Authorizing `identity:get_project(project_id=27f57edf07f34b868c79396b818ec481)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:29.577981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85e935-5c02-47b2-b365-71817f17dc53 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:29.579911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 50/96] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:29 2022] GET /identity/v3/projects/27f57edf07f34b868c79396b818ec481 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:29.586385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88110b04-295f-432c-9a70-514a31977518 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:29.712567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88110b04-295f-432c-9a70-514a31977518 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:29.753909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:29.754590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:29.754870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:29.755141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:29.756020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=27f57edf07f34b868c79396b818ec481, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:29.756324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:29.757942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1065e9-28bf-4c86-a763-f9c493032f46 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:29.767070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 47/97] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:29 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=27f57edf07f34b868c79396b818ec481&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:30.915150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea880e3-c51a-446f-8e22-a4899618b181 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:30.916202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea880e3-c51a-446f-8e22-a4899618b181 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:30.916689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea880e3-c51a-446f-8e22-a4899618b181 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:30.918710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 51/98] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:30.924086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:30.924912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:30.925411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:30.950479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:30.952066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:31.030794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 48/99] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:31.065196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea880e3-c51a-446f-8e22-a4899618b181 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.195239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea880e3-c51a-446f-8e22-a4899618b181 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.239917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.241073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.241618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.242093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.254540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:31.267051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:31.268644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 52/100] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:31.275006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.392212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c77b1-eb41-4d84-9cb7-f8417b308dff None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.444879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.446433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.446664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.446946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.447732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:31.448045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:31.449571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee604-7d49-4c4a-83d8-ca6f990abd5c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:31.459284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 49/101] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:31.465395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.480863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc8577-c218-4c60-bc56-9f6431e0b4a9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.481176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc8577-c218-4c60-bc56-9f6431e0b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.481429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc8577-c218-4c60-bc56-9f6431e0b4a9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.484464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 50/102] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:31.491276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.491276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.491276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.507526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:31.509556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:31.575354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 51/103] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:31.598730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.633156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa46f7-6de8-4655-88b2-c683931b0066 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.696094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0fc0a-d8a0-4d12-8cba-286686da32ce None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.702250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.703083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.703369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.703648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.705797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:31.707598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:31.709241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:31.714855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.731750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.732751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.733172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.733612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.744587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:31.751671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:31.753000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 52/105] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:44:31.764554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.887777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953059-6920-47b3-ac92-869ed6cf3462 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.895892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42814df-0bc2-4752-9f48-45951216d8e7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:31.922591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.924119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.924624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.925127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.926806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:31.928971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:31.929517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:31.930703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:31.930989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:31.931269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:31.932006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:31.932311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:31.933001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 54/106] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:31.937534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:31.938636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:31.942046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 53/107] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:31.948237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:32.126501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f3014-3809-48cc-8dd6-9fa53e0be34e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:32.130221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8367d8-06f6-498b-985e-a86b3753882a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:32.170799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:32.172093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.172569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.173033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] PATH_INFO: `/v3/users/3a743172fc3d4434823fe28bd0f1b483` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.187446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] RBAC: Authorizing `identity:get_user(user_id=3a743172fc3d4434823fe28bd0f1b483)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:32.189334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:32.191261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 54/108] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:31 2022] GET /identity/v3/users/3a743172fc3d4434823fe28bd0f1b483 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:32.197614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:32.209003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:32.209718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.210005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.210281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/6204752a1dd94b6cb3197a2995039443/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.212390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, user_id=6204752a1dd94b6cb3197a2995039443, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:32.213894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:32.298792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbd7d-f2e3-4d94-a965-f94b4aa11de9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:32.299654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 55/109] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:31 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/6204752a1dd94b6cb3197a2995039443/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 05:44:32.337085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:32.338508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.339004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.339492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.429157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:32.431810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f672a-25f5-4057-a32e-450159132656 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:32.550677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 55/110] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:44:32.557086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:32.625926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f36f-3940-444e-8b9c-ed496c0a7d10 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.626223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f36f-3940-444e-8b9c-ed496c0a7d10 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.626500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f36f-3940-444e-8b9c-ed496c0a7d10 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.628456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 56/111] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:32.633869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.634163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.634445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.652065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:32.653194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:32.727868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 57/112] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:32.754088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:32.754433 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac471e0-2a7f-433e-97a7-416e0fcbd6ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:32.807010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:32.808235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.808726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.809206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.810620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:32.812259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:32.814166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 56/113] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:32 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:32.835412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:32.862747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eec516-8a82-494e-91d8-edfcbd480b83 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:32.899588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:32.900417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:32.900704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:32.900988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:32.902363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:32.903816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:32.905702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 58/114] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:32.911491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.012331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefa5ba-5e70-4f60-bc89-12def60cf2f6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.047801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.048618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.048910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.049193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.050071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=3a743172fc3d4434823fe28bd0f1b483) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:33.050386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:33.051936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999421d1-36ed-4e7a-a3d0-7738d2605133 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:33.058339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 57/115] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:32 2022] GET /identity/v3/role_assignments?user.id=3a743172fc3d4434823fe28bd0f1b483&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:33.101718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a49540-cbc6-4e75-a046-5c5593b50b75 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.124102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03ac7c-1832-4a77-be81-a07370df262f None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.124400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03ac7c-1832-4a77-be81-a07370df262f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.124687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03ac7c-1832-4a77-be81-a07370df262f None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.126635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 58/116] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:33.133647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0b2f-c817-47c0-9892-3eaf3a900cbb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.133950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0b2f-c817-47c0-9892-3eaf3a900cbb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.134209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0b2f-c817-47c0-9892-3eaf3a900cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.159563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.160170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.160454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.160734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.161479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:33.162977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:33.170613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d02a0b2f-c817-47c0-9892-3eaf3a900cbb None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:33.171914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d02a0b2f-c817-47c0-9892-3eaf3a900cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:33.245365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 59/117] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:33.246789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bac27-1dbf-40ee-9bad-b2c04e2ee4c9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.247088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bac27-1dbf-40ee-9bad-b2c04e2ee4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.247371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bac27-1dbf-40ee-9bad-b2c04e2ee4c9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.249302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 60/118] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:33.255107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.258649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.258649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.275214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:33.276426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:33.295302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 59/119] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:44:32 2022] POST /identity/v3/projects => generated 302 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:33.296112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.400372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 61/120] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:33.428900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.512391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6132-5cd9-434c-ad3b-5bb7da92e8e0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.549893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf614-14af-463d-9f36-00831c5106e7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.572969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.574396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.575035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.575844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.586314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.587115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.587385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.587661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.590972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:33.597956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:33.600182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-7e9da862-cab3-4a01-a131-8b0f1e74a6b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:33.601741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 60/121] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:33.603184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612310-abcc-44eb-8bcf-9c27739cdc46 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.603672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612310-abcc-44eb-8bcf-9c27739cdc46 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.604219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612310-abcc-44eb-8bcf-9c27739cdc46 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.606728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 61/122] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:33.608969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47612310-abcc-44eb-8bcf-9c27739cdc46 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.614750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2f5b0b92-9e9b-4078-8d00-cd8a0c2eb9ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:33.616117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 62/123] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:44:33.621475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.621475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.621475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.635769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:33.636952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:33.709038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 63/124] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:33.710304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.740720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47612310-abcc-44eb-8bcf-9c27739cdc46 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.775589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.776595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.777081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.777633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.778585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:33.779089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:33.780685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:33.789945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 62/125] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:33.791035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.833983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055afccb-8062-4502-ac37-efd5c1afded5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.877728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.878441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.878674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.878951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.879707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:33.880010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:33.881480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:33.893893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 64/126] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:33.894419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7dd-e7dc-4632-a485-054ebf0ce2ba None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:33.894719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:33.934136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:33.937485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:33.937982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:33.939226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:33.964218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:33.971517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:33.981793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 63/127] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:33.983758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.087276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe7657-b656-49d5-bfe3-1d9df35bcd80 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.125849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.127268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.127780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.128297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.130003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.133402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.136103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 65/128] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.138155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.192078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b66b0-b87c-4569-ba19-fd0ec94d7ca1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.238561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.239792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.240283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.240780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.242755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.244420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.246305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 64/129] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:33 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.247266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.309001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1706-87b5-46fe-9cdb-2efadc8dbcc5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.353921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6145cb-0c3a-4482-a4a7-ecdd40881e08 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.390750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.391622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.391908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.392193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.393396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.394897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.395731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.396506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.396927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:34 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.397028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.397186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.397518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.398001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:34.398357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.403380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.420713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.421668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.509078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc2bd5-8f13-482a-8916-726827a86199 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.545785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.546668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.546960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.547239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.548462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.549979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.552405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 66/132] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:34 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.553184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.629667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08111b-48cd-4dd6-aec4-ed7318a532d1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.667248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7ec1-4821-4b53-a00a-37cc7094c5c7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.690135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.691346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.691825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.692293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/6204752a1dd94b6cb3197a2995039443/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.694780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, user_id=6204752a1dd94b6cb3197a2995039443, role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.696519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.705460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.705460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.705460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.705460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.706276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.708205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.710240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 67/133] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:34 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:34.711525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.817822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cace14-c655-4a4e-a64b-1d42cf53a771 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:34.839624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 67/134] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:34 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/6204752a1dd94b6cb3197a2995039443/roles/ace62a47cba3428196ca1286882b1fae => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:34.840996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:34.853013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:34.853962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:34.854247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:34.854527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/bc9a8d70ef924eccb0a2efd6a32909f6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:34.856556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, user_id=bc9a8d70ef924eccb0a2efd6a32909f6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:34.858078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:34.988710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 68/135] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:34 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/bc9a8d70ef924eccb0a2efd6a32909f6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:35.019114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b69c-4416-4b00-bd77-83c2033146fe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:35.063395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:35.064331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:35.064620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:35.064901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] PATH_INFO: `/v3/projects/27f57edf07f34b868c79396b818ec481` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:35.066405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] RBAC: Authorizing `identity:get_project(project_id=27f57edf07f34b868c79396b818ec481)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:35.068013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871472-fb61-44f7-a308-76f75918d8db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:35.069839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 68/136] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:34 2022] GET /identity/v3/projects/27f57edf07f34b868c79396b818ec481 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:35.076040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:35.212739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221f40-81c8-4106-b41e-07f1e6043dd2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:35.251382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:35.252635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:35.253112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:35.253633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] PATH_INFO: `/v3/projects/27f57edf07f34b868c79396b818ec481/users/6204752a1dd94b6cb3197a2995039443/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:35.258894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] RBAC: Authorizing `identity:create_grant(project_id=27f57edf07f34b868c79396b818ec481, user_id=6204752a1dd94b6cb3197a2995039443, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:35.260631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2797dd-8b50-4a78-89f4-a10103040b5d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:35.328109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 69/137] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:35 2022] PUT /identity/v3/projects/27f57edf07f34b868c79396b818ec481/users/6204752a1dd94b6cb3197a2995039443/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:35.544948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219ea6-f0ef-47e8-a053-cfbd681a5f07 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:35.546001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219ea6-f0ef-47e8-a053-cfbd681a5f07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:35.546542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219ea6-f0ef-47e8-a053-cfbd681a5f07 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:35.548711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 69/138] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:35.556180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:35.556776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:35.557258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:35.579348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:35.580895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:35.661473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:35.686885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219ea6-f0ef-47e8-a053-cfbd681a5f07 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:35.795095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219ea6-f0ef-47e8-a053-cfbd681a5f07 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:35.831865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:35.833362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:35.833883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:35.834416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:35.847157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:35.855728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:35.857312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 70/140] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:35.863768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:35.967664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36579c7c-b993-4983-af08-3a21c29729a9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.006643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.007704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.008193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.008684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.009705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:36.010385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:36.011985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:36.024331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 71/141] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:36.030209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.134476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9676d-ba8e-46ea-8bcd-bd59fa283d33 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.169618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.170838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.171386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.171898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.173314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:36.174997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66526b11-0718-403b-8e6f-07b29fc29235 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:36.181402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 71/142] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:36.182998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.234918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff36d4-2024-469c-877b-91c8ae8e0211 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.235246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff36d4-2024-469c-877b-91c8ae8e0211 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.235487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff36d4-2024-469c-877b-91c8ae8e0211 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.237278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 72/143] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:36.242498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33084e32-b39c-442e-941e-917179877e52 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.242790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33084e32-b39c-442e-941e-917179877e52 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.243078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33084e32-b39c-442e-941e-917179877e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.273918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-33084e32-b39c-442e-941e-917179877e52 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:36.275142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-33084e32-b39c-442e-941e-917179877e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:36.299785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba66e4-ad71-45e8-95b9-9ddf5757d91f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.348725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.349397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.349712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.349990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.429925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 73/144] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:36.452591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33084e32-b39c-442e-941e-917179877e52 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.504614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:36.507216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:36.636320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 72/145] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:36.643489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.683413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33084e32-b39c-442e-941e-917179877e52 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.737876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05970bf-adbf-4fcc-8e52-137107fb8c0b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.759497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.760297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.760581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.760858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.772785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.773727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.774011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.774289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.775498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:36.776941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:36.778752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 73/146] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:36.784512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.790386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:36.797361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:36.798612 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 74/147] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:36.804830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:36.883482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8e21-7030-4a2f-b71d-ec92d3e181e2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:36.923589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:36.924166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.924449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.924727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.925590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:36.925907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:36.927349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22981f-7f17-446b-bedf-726d94d473a6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:36.936759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 74/148] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:36.942856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6662fb-e6e8-44f2-a1aa-30ff5405717e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.943149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6662fb-e6e8-44f2-a1aa-30ff5405717e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.943430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6662fb-e6e8-44f2-a1aa-30ff5405717e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.947828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 75/149] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:36.955878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:36.956181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:36.956437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:36.987044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:36.988614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:37.036389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda79d4-6855-468a-a9de-d7e5e7f118fd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.088106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.090049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.090858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.091354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.092394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:37.092923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.094910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.105895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 75/150] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:37.111692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:37.113787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 76/151] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:37.162501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:37.245473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5118630-091a-4088-bb9d-875ee9a334b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.276739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.277665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.277947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.278223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] PATH_INFO: `/v3/users/3a743172fc3d4434823fe28bd0f1b483` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.279474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] RBAC: Authorizing `identity:get_user(user_id=3a743172fc3d4434823fe28bd0f1b483)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.280988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.282774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 76/152] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:37 2022] GET /identity/v3/users/3a743172fc3d4434823fe28bd0f1b483 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:37.289359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:37.312613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548a25-13bb-4374-a8fb-279cedf702c2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.358685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.359934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.360364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.360647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.361921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.363562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.366921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 77/153] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:37.371736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:37.424094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebebd-a2d1-4be0-8ee9-d95124c98e02 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.490373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.491584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.492038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.492480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.495580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.497225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.499306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 77/154] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:37 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:37.506239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:37.555741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabcc6-4f6f-4fd2-8a20-44e69c623be5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.615087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.616033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.616532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.617097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.617991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.622004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2400a7d-fe9e-43a0-a5d7-c6192057a0dd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.665235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1572-146b-459e-8847-87b73db46aa6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:37.700506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:37.702227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:37.702705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:37.703148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/3a743172fc3d4434823fe28bd0f1b483/roles/2703ba06ba7d48b385ad98fb267e49f8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:37.705303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, user_id=3a743172fc3d4434823fe28bd0f1b483, role_id=2703ba06ba7d48b385ad98fb267e49f8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:37.707326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e090d9e-bf82-490b-99f5-06504a0d8a85 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:37.736540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 78/155] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:37 2022] POST /identity/v3/users => generated 283 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:44:37.784022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:37 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/users/3a743172fc3d4434823fe28bd0f1b483/roles/2703ba06ba7d48b385ad98fb267e49f8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:38.361096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef024741-d449-4c1c-a707-333fdf1b0185 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.361644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef024741-d449-4c1c-a707-333fdf1b0185 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.361644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef024741-d449-4c1c-a707-333fdf1b0185 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.363578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 79/157] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:38.370962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea959-4040-4430-835c-cdcca9350553 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.370962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea959-4040-4430-835c-cdcca9350553 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.370962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea959-4040-4430-835c-cdcca9350553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.388691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-074ea959-4040-4430-835c-cdcca9350553 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:38.390147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-074ea959-4040-4430-835c-cdcca9350553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:38.467083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:38.497988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef024741-d449-4c1c-a707-333fdf1b0185 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:38.603413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea5bf-8b33-4d99-9097-a7eaef70e383 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.604690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea5bf-8b33-4d99-9097-a7eaef70e383 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.605200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea5bf-8b33-4d99-9097-a7eaef70e383 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.607225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 80/159] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:38.614325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef024741-d449-4c1c-a707-333fdf1b0185 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:38.616941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.617456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.617965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.637627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:38.639731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:38.659981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:38.660798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.661082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.661361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.673603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:38.681749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9b00735b-4ab7-4295-839d-0cdefd25de5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:38.683150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 80/160] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:38.684286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b773b4-80a8-49a4-9cf5-109d4a00b9af None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.684639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b773b4-80a8-49a4-9cf5-109d4a00b9af None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.684924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b773b4-80a8-49a4-9cf5-109d4a00b9af None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.689456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 81/161] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:38.692210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.692501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.692784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.711897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:38.713064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:38.735646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:38.737257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:38.803679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 82/163] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:38.810335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:38.853768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3080a-b0a4-49af-9ed1-bb2ebe2bf7ae None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:38.897211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:38.898268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.898751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.899241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.900218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:38.900718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:38.904229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:38.912904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 82/164] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:38.914067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:38.937425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd9014-712b-48e9-9aac-014facb13cd2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:38.973920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:38.975054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:38.975162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:38.975395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:38.986382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:38.993955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:38.995365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 83/165] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:39.000803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.019041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd7376-b1a3-4e9c-bbcf-ff1c91cfa7ab None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.052661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.054319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.054845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.055316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.066355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:39.074420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:39.075970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 83/166] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:39.076938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.109853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4e07-826f-4431-b9d4-154168234089 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.144089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.144970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.145249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.145562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.146772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.148295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.149901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 84/167] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:38 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.154290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.185580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abd39e-3c75-4d58-b40f-137100f0123b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.220130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.221148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.221747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.222221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.223172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:39.223674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.225323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.234853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.235981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.266701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42575-de94-43f6-ab1c-8f37e3d4aa8b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.302415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.302415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.302694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.302948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.303623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:39.303978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.305562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.314068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.318537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.345715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e81f9d-6ebc-4bfe-a2ad-b60467ab07a1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.380056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.381069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.381603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.382634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.423919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da96e2-661f-4e06-8c82-4deae996ff22 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.453815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.455762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.460024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.460159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.460450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.460726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] PATH_INFO: `/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.462043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] RBAC: Authorizing `identity:get_user(user_id=bc9a8d70ef924eccb0a2efd6a32909f6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.463494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.465394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 86/170] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/users/bc9a8d70ef924eccb0a2efd6a32909f6 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.469634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.559181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 85/171] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:39.560388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.576963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0573d7-231e-44ed-8862-ec7638cdd5ec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.611384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.612258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.612541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.612814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] PATH_INFO: `/v3/users/6204752a1dd94b6cb3197a2995039443` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.614067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] RBAC: Authorizing `identity:get_user(user_id=6204752a1dd94b6cb3197a2995039443)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.615519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.617723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 87/172] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/users/6204752a1dd94b6cb3197a2995039443 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.622259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.663889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61df87-7aad-4b12-a584-041a2b8f0b21 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.699088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.700061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.700548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.701036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.723080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdb71-fd53-4f73-bd6c-233e8160fb6c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.756849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.758418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.758526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.758804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.760007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.761479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.763328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 88/173] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:39.768691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.772663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:39.774798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:39.868925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694499a-ebb7-4774-aed4-d5695b30ea49 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:39.874646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 86/174] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:39.875816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:39.907473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:39.908125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:39.908463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:39.908742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:39.976528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c5c7-7ac0-467d-b4ca-e37c9dfc1965 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:40.012449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:40.013423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:40.013927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:40.014396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:40.015424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:40.015952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.017708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.023815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 87/175] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=ace62a47cba3428196ca1286882b1fae => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:40.024895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:40.081424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.083224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.130246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c460-e757-4374-9c21-6bcc3bd66450 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:40.166965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:40.168274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:40.168754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:40.169249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:40.170760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.172426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.174362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 88/176] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:40 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:40.181971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:40.322863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 89/177] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:40.328486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:40.375152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e25ce-1e0b-4770-a972-ab1de5c705bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:40.414454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:40.415287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:40.415671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:40.416048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:40.416996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=bc9a8d70ef924eccb0a2efd6a32909f6) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:40.417415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.419025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.425909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 89/178] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:40 2022] GET /identity/v3/role_assignments?user.id=bc9a8d70ef924eccb0a2efd6a32909f6&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:40.604959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4ad83-bbe1-4d47-a0ff-cf7e9e0b8c48 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:40.670177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:40.671057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:40.671336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:40.671611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] PATH_INFO: `/v3/projects/27f57edf07f34b868c79396b818ec481` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:40.672877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] RBAC: Authorizing `identity:get_project(project_id=27f57edf07f34b868c79396b818ec481)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.674367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31d71-6549-4b09-b987-d82c4d89fb9b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.676101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 90/179] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:40 2022] GET /identity/v3/projects/27f57edf07f34b868c79396b818ec481 => generated 312 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:40.684424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:40.825921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634079bb-e05a-4020-bf68-4a3cc1178d4d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:40.862313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:40.862963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:40.863192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:40.863471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:40.864319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=27f57edf07f34b868c79396b818ec481, user.id=6204752a1dd94b6cb3197a2995039443) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:40.864632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:40.866168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c290d-1808-41c9-9d2c-7240401f728d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:40.872440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 90/180] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:40 2022] GET /identity/v3/role_assignments?user.id=6204752a1dd94b6cb3197a2995039443&scope.project.id=27f57edf07f34b868c79396b818ec481&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:41.342695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c65ba-49db-442a-adf4-5d2bce2fa21c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.343042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c65ba-49db-442a-adf4-5d2bce2fa21c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.343248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c65ba-49db-442a-adf4-5d2bce2fa21c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.345031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 91/181] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:41.352258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.352258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.352450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.433325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:41.434521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:41.507695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 91/182] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:41.531093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c65ba-49db-442a-adf4-5d2bce2fa21c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:41.635092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c65ba-49db-442a-adf4-5d2bce2fa21c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:41.669600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:41.670452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.670790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.671068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.681846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:41.688854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:41.690401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 92/183] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:41.696381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:41.795484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff9a04-4d16-4f25-b9c1-897d332a8c6b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:41.830976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:41.832668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.833236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.833724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.834701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:41.835194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:41.836832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f694b6-4145-49e2-bf1f-d911f8f9eae3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:41.845507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 92/184] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:41.851330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:41.861809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e22b-8acf-4474-828d-2c2b3e6f19de None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.862097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e22b-8acf-4474-828d-2c2b3e6f19de None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.862377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e22b-8acf-4474-828d-2c2b3e6f19de None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.864164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 93/185] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:44:41.869767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:41.870052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:41.870328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:41.890239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:41.891685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:41.963877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 94/186] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:41.986271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa1d5-504c-49b6-8c2f-677422f095a7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:41.995598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.026441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.027721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.028192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.028657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] PATH_INFO: `/v3/users/3a743172fc3d4434823fe28bd0f1b483` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.030268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] RBAC: Authorizing `identity:get_user(user_id=3a743172fc3d4434823fe28bd0f1b483)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.032141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.034471 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 93/187] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:41 2022] GET /identity/v3/users/3a743172fc3d4434823fe28bd0f1b483 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:42.040436 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.118313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10993b-0439-4ab2-b570-e75a08ca1bff None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.143956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c90f4e-cf3f-441a-afe2-a9f65ec15284 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.160250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.161045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.161333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.161629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.176194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:42.180589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.181498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.181975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.182438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.183893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:42.185157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 95/188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:44:42.191978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.259186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.260991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ab84-0661-49fb-8a3b-3566a8765436 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.308857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d25dc-62d5-4b5c-b3ec-8513b49126fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.342629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.343646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.344115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.344586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.345467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:42.345830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.350988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8517-2ce0-442c-8fdc-aa284c222a2e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.359544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 96/189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:42.361050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddf1d-7162-4d3a-be40-9b2851628081 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.361367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddf1d-7162-4d3a-be40-9b2851628081 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.361710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ddf1d-7162-4d3a-be40-9b2851628081 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.365277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 97/190] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:42.365277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ddf1d-7162-4d3a-be40-9b2851628081 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.386986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 94/191] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:44:42.388268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.388553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.388827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.405993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:42.407083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:42.469443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ddf1d-7162-4d3a-be40-9b2851628081 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.470256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 95/192] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:42.471076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.502803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.503668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.503944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.504211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.516992 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.518470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde4637-087a-4ba3-a58b-d1a1db59b40e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.520089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:42.522923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c6e32-fad1-47cc-920f-87c82420d2fd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.523217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c6e32-fad1-47cc-920f-87c82420d2fd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.523490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c6e32-fad1-47cc-920f-87c82420d2fd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.525257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 99/194] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:42.525257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c6e32-fad1-47cc-920f-87c82420d2fd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.567837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1355a-dde7-4329-8674-ac25697bd09f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.599907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.601293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.601600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.601869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.603042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.604483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.606186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 96/195] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:42.606937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.620862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c6e32-fad1-47cc-920f-87c82420d2fd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.653453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.654256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.654561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.654833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.665137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:42.672373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9dc3cb48-eb44-44d9-870b-0c348652a7fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:42.673560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 100/196] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:42.673560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.673560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.673560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.692714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:42.693936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:42.703807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b7de7-2b5d-4143-a1e9-3b2cf384ee42 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.736491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.737128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.737412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.737717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.756079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 101/197] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:42.762282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.801189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.802685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.856880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a4413-70c4-4af6-ac44-ee2b96a17cec None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:42.888592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:42.889234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:42.889546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:42.889825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:42.890651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, scope.project.id=06fc65a8101d4011b29fe6eff82786ba, user.id=3a743172fc3d4434823fe28bd0f1b483) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:42.890960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:42.892432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:42.893871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 97/198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:42.894682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:42.899144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 102/199] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/role_assignments?user.id=3a743172fc3d4434823fe28bd0f1b483&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:42.899861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.001700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65f5bd-d86f-494a-929d-5a33a70a2c2f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.003295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c1c2-52ba-4dfe-a077-5eceb14e6801 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.037339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.038086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.038366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.038640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.039392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:43.039695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.041106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.046056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.047779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.048313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.048731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.049922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 98/200] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:43.050423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.050759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.052391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.054600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 103/201] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:43.055510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.166642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943b06-add9-408f-9a5c-0d321d56c21c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.166932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0be8-d6fb-44c6-8b97-cc22ee4bcc72 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.198797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.198950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.199659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.199751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.199936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.200022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.200207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.200301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.201380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.201505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.202876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.202969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.204707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 104/202] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:43.204833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 99/203] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:43.205225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.210337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.297522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea294656-be9b-485c-a447-66a18031aa2b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.301004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb9641-ba55-4027-9d21-20e49fca8ccf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.329234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.330003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.330345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.330678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.331631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.332501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.333071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.333158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.333395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.333698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.396511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.398560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.404553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 105/204] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:43 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:43.417740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.502305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 100/205] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:43.508296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.515278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc981-dcd6-4708-a822-b27f714f7d5b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.550078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.550654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.550932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.551206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.552241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=6eead9b767e34f0c94348433c1aff30a) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:43.552565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.554645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.560819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 106/206] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/role_assignments?user.id=6eead9b767e34f0c94348433c1aff30a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:43.613589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc270c-c77e-4393-9d7c-d204efb70a0f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.651840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.653575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.653575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.653575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.654813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.656386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d86be2-a967-4d56-9ca7-39e2a418ad5f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.658187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:43.665175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:43.772759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcd5f-09ec-44f8-b6c8-d60307842a02 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:43.808205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:43.808787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:43.809070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:43.809346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:43.810224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=6eead9b767e34f0c94348433c1aff30a) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:43.810534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:43.811994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2592adb-fbbc-49c7-ad1a-fb84f3f8e984 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:43.818008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:43 2022] GET /identity/v3/role_assignments?user.id=6eead9b767e34f0c94348433c1aff30a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=ace62a47cba3428196ca1286882b1fae => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:45.869604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d132ef-2f3e-4d81-957a-f6c11fe6632b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:45.870111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d132ef-2f3e-4d81-957a-f6c11fe6632b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:45.870215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d132ef-2f3e-4d81-957a-f6c11fe6632b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:45.872072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:45.877386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484724a4-0996-47e5-84b6-0cc8d6632c3c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:45.878182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484724a4-0996-47e5-84b6-0cc8d6632c3c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:45.878644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484724a4-0996-47e5-84b6-0cc8d6632c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:45.896640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-484724a4-0996-47e5-84b6-0cc8d6632c3c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:45.898166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-484724a4-0996-47e5-84b6-0cc8d6632c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:45.965193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 108/210] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:45.979398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab232e0-7ef5-4f70-82ee-6a4de7365e42 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:45.979689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab232e0-7ef5-4f70-82ee-6a4de7365e42 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:45.979965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab232e0-7ef5-4f70-82ee-6a4de7365e42 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:45.981785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 103/211] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:45.986619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a104-3f55-4ad1-9632-07ce5d4855ca None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:45.986873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2f41-8a2c-4652-b5b8-b43d5c566d1e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:45.986978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a104-3f55-4ad1-9632-07ce5d4855ca None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:45.987165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2f41-8a2c-4652-b5b8-b43d5c566d1e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:45.987279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a104-3f55-4ad1-9632-07ce5d4855ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:45.987448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2f41-8a2c-4652-b5b8-b43d5c566d1e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:45.989880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 109/212] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:45.994340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad2f41-8a2c-4652-b5b8-b43d5c566d1e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.004962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7311a104-3f55-4ad1-9632-07ce5d4855ca None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:46.006222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7311a104-3f55-4ad1-9632-07ce5d4855ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:46.073616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 104/213] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:46.073616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.073616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.073616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.094226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad2f41-8a2c-4652-b5b8-b43d5c566d1e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.095663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:46.096844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:46.128368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.129411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.129919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.130368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.140331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:46.147569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:46.148936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 110/214] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:46.150029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.161098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:46.161959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.247785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8252-ce4f-4441-b6ab-43b4c46c026c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.254671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7764c7-5ac5-4968-8461-34e617c1f6a6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.279176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.279955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.280237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.280516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.285977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.286628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.286905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.287202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.288458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:46.288756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.290141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e29343-9b8e-49ff-9dda-9607a499f828 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.291143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:46.297936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 106/216] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:46.298316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:46.298936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d20de-bad3-43d3-872c-2109110c25db None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.299218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d20de-bad3-43d3-872c-2109110c25db None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.299493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d20de-bad3-43d3-872c-2109110c25db None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.299583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 111/217] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:46.304482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.304565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 107/218] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:46.304565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d20de-bad3-43d3-872c-2109110c25db None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.398328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc56d8-506d-49ad-9470-41d68965bc2e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.400138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d20de-bad3-43d3-872c-2109110c25db None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.430408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.431193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.431476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.431676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.431777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.432535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.432803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.432958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.433068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] PATH_INFO: `/v3/users/f96702cff0514ef289720cc13e375ba8` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.434449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.436056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 112/219] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:46.440816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.446473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] RBAC: Authorizing `identity:get_user(user_id=f96702cff0514ef289720cc13e375ba8)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.447933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daed7de-9d77-4324-8431-3955fd75eb32 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.449782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 108/220] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/users/f96702cff0514ef289720cc13e375ba8 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:46.454205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.454205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.454205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.469674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:46.470844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:46.532553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520894e-378c-471d-8bcc-793c01ae311b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.533307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 109/221] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:46.534149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.565089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.565776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.566059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.566332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.567071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:46.567372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.569235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.577145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 113/222] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:46.577847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.630277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9a5b1-812c-4142-a9c2-a62427374e1a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.661743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.662833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.663111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.663380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.664080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.665541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.676074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a15e-18de-46be-937a-f32edc9d2705 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.707939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.708573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.708855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.709156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.769372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 110/223] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:46 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:46.770236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.774744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:46.776605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:46.875913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a313-c4c5-4999-abf2-3c3a465c1e79 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:46.881813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 114/224] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:46.887215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.912074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:46.912871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:46.913152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:46.913427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:46.924495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:46.932515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:46.934006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 111/225] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:46.935732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:46.990912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fde39f-5b07-44d2-ab03-3d296a073fe2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.027403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.028289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.028666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.028956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.030448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.031914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.033855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 115/226] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.034558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.044595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e879-9071-4ee1-932c-90e946ebd058 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.082754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.083862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.085022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.085316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.086609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.088841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.089927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 112/227] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:46 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.090797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.161192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76802-594d-47b2-af10-29e39a22cb29 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.196889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc4bf-6b78-4a5c-8108-224a0d2d702d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.197252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.198163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.198645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.199100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.200035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:47.200537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.202142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.210879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 116/228] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.211916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.231243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb676-51c6-4058-958b-d237532b179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.232115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb676-51c6-4058-958b-d237532b179e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.232399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb676-51c6-4058-958b-d237532b179e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.232674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb676-51c6-4058-958b-d237532b179e None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.233922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cb676-51c6-4058-958b-d237532b179e None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.235386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cb676-51c6-4058-958b-d237532b179e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.237078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 113/229] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:47 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.237969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb676-51c6-4058-958b-d237532b179e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.312431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a846-f6af-485b-8829-37f42ef77122 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.338980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb676-51c6-4058-958b-d237532b179e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.346594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.347534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.348004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.348465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.349502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=f96702cff0514ef289720cc13e375ba8) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:47.350523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.352175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.358113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 117/230] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:47 2022] GET /identity/v3/role_assignments?user.id=f96702cff0514ef289720cc13e375ba8&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.359088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.382663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.383665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.384486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.384486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.385805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.387379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.392932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 114/231] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:47 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.394765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.507155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac490-924b-412d-83ff-541b9c9d9517 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.541749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb76bf-5dce-4b26-869a-5b12454b911e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.544403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.545555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.546037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.546508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.547920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.549665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.551948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 115/232] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:47 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:47.558465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:47.577461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.578159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.578438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.578710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/6eead9b767e34f0c94348433c1aff30a/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.580708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, user_id=6eead9b767e34f0c94348433c1aff30a, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.582402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25ae96-16ec-4ed6-b022-a78b4b2f7579 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.650427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 118/233] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:47 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/6eead9b767e34f0c94348433c1aff30a/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:47.672161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a85a-b820-4ead-a213-a413148db0be None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:47.707513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:47.708432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:47.708709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:47.709540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/6eead9b767e34f0c94348433c1aff30a/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:47.711898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, user_id=6eead9b767e34f0c94348433c1aff30a, role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:47.713391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7e494-1943-4410-8d76-21b16bfa47a5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:47.794169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 116/234] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:47 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/6eead9b767e34f0c94348433c1aff30a/roles/ace62a47cba3428196ca1286882b1fae => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:49.385792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca298c1-fe57-4384-a99b-3844fc8fd854 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.386284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca298c1-fe57-4384-a99b-3844fc8fd854 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.386357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca298c1-fe57-4384-a99b-3844fc8fd854 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.388112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 119/235] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:49.393372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.393845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.394021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.416428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:49.417635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:49.496756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 117/236] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:49.525816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca298c1-fe57-4384-a99b-3844fc8fd854 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:49.648071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca298c1-fe57-4384-a99b-3844fc8fd854 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:49.695573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:49.696376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.696661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.696937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.711789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:49.718857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-24e04f48-20be-4a64-a37c-d0549ee367e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:49.720087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 120/237] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:49.726528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:49.801014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc88f-3b09-4828-8a45-cadd0725f5f9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.801327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc88f-3b09-4828-8a45-cadd0725f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.801604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc88f-3b09-4828-8a45-cadd0725f5f9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.803712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 121/238] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:49.819336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.819625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.819904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.850413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:49.851623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:49.854248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998a26-2085-45a2-be84-98bc3fb27373 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:49.888776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:49.889460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:49.889748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:49.890019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:49.890771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:49.891071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:49.892465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:49.900859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 118/239] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:49.912972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:49.963432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 122/240] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:49.992058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.080578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589a90-a841-44fa-bd13-8b9073d7a215 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.118432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.119398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.119687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.119967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] PATH_INFO: `/v3/users/922ebcbd869b473499af3978fafce573` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.134636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] RBAC: Authorizing `identity:get_user(user_id=922ebcbd869b473499af3978fafce573)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.136298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.138744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 119/241] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:49 2022] GET /identity/v3/users/922ebcbd869b473499af3978fafce573 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:50.144553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.178181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4970ca-845d-4faa-ac8c-6eb09e0fb7b7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.244522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.245673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.246154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.247255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.248751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.251570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.257107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 123/242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:50.270543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.288289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2a1c-fb03-47dd-8ce4-3386fff1f7eb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.324987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.325669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.325955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.326233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.423769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.425253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.459940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cacc-3ad1-4170-b1ee-587be80a73fa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.522836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.523907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.524404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.524841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.525745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.527524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774ccc-3f8c-4440-bf38-848a60f29713 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.530410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 120/243] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:44:50.535791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.609473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 124/244] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:50 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:50.609473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f56a-d6cc-4f88-a70a-49c60ff09b91 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.609473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f56a-d6cc-4f88-a70a-49c60ff09b91 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.609473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f56a-d6cc-4f88-a70a-49c60ff09b91 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.609473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 125/245] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:50.612507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58b3a-7265-4237-bdb7-5f5a906cae9b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.612507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58b3a-7265-4237-bdb7-5f5a906cae9b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.612507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58b3a-7265-4237-bdb7-5f5a906cae9b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.613827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 126/246] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:50.620039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.620333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.620606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.638779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:50.640060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:50.643314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e8c7-cdb4-4c1f-9354-267daaac3250 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.679380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.680262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.680542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.680815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.682103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.683615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262fbd-d802-43d5-9a84-ef20b3161054 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.685413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:50 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:50.690596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.690596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.690596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.711296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:50.712410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:50.730790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 127/248] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:50.732207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.808141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 122/249] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:50.812787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.862051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5282c-1a91-4f64-adb0-cfd4937c0335 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.910478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.911438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.911900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.912177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.913023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=922ebcbd869b473499af3978fafce573) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:50.913333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:50.914855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:50.919342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bee9e-9296-4c71-a343-1bbfab22ca82 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:50.921195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 128/250] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:50 2022] GET /identity/v3/role_assignments?user.id=922ebcbd869b473499af3978fafce573&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:50.922053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:50.976387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:50.977216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:50.977554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:50.977833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:50.989543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:50.997738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-abb35613-b2ee-4b7d-bb53-c5cf3c572eb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:44:50.999025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 123/251] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:51.000334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab360-ce62-4449-aff2-e66859c06358 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.000624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab360-ce62-4449-aff2-e66859c06358 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.000941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab360-ce62-4449-aff2-e66859c06358 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.002948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 124/252] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:51.007839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab360-ce62-4449-aff2-e66859c06358 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.057078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4130a0-f77b-47c7-8d84-286d03ab3f93 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.100430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.101299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.101617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.101892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.114796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:51.122504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-3ca2e383-2a93-499a-8fea-4fb7ab5c6c95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:51.123816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 129/253] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:51.125007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.125293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.125595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.134813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab360-ce62-4449-aff2-e66859c06358 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.143581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:51.144825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:51.179042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.180189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.180639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.181086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.182299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:51.182801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:51.185201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:51.194099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 125/254] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:51.195195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.251043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:51.251662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.300619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e11fe5-7058-40ad-8a36-eacb5359f7ad None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.342130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.343137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.343615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.344076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.345036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:51.345585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:51.347201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:51.362025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:51.363868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.458230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150cd80-1f2b-4437-9b37-bcb39eb5c0ba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.526515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.527311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.527595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.527864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.530634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:51.532103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:51.533732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:51.534482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.557136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3091-a1a3-4c7a-b22a-d5595b33d280 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.598819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.600581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.600859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.601133 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.612075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:51.620025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:44:51.621818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 127/258] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:51.622607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.711528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6e1c9-c392-4e33-8cd4-028cd6936ea7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.736083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006cb76-28f1-4054-9cd6-0db3aebad36a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:51.772832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.777582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.778174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.778699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.792284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:51.793528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:51.794013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:51.794484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] PATH_INFO: `/v3/users/f96702cff0514ef289720cc13e375ba8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:51.797839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] RBAC: Authorizing `identity:get_user(user_id=f96702cff0514ef289720cc13e375ba8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:51.799542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:51.801396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 132/259] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/users/f96702cff0514ef289720cc13e375ba8 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:51.803759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:51.889843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:51.891655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.010266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eade2-8935-49a5-9e56-f4b6c1d9497e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.022433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 128/260] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:52.022801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.110207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.111240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.111723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.112204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.113155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:52.113676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.115415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.127156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f741-6dea-4307-a2a3-ba80645926c6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.134156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 133/261] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:44:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:52.135306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.167947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.168820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.169100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.169371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.170586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.172040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.174114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 129/262] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:52.175044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.305754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8f7c-93cc-4ad7-a33f-cf5798fbda6e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.352438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.352438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.352438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.352438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] PATH_INFO: `/v3/users/6eead9b767e34f0c94348433c1aff30a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.353693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] RBAC: Authorizing `identity:get_user(user_id=6eead9b767e34f0c94348433c1aff30a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.355167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.365054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 130/263] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/users/6eead9b767e34f0c94348433c1aff30a => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:52.365054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.371204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ac9c1-b49b-4207-b16c-c3ccb9322da6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.413106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.415196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.415481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.415757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.419324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.420788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.422501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 134/264] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:52.426555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.540483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd3e12-5b0e-491c-88a8-81f2bc66e705 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.602289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa603-c58f-4cba-a542-fe3735c3b2fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.611485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.612931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.613447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.613919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/f96702cff0514ef289720cc13e375ba8/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.622274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, user_id=f96702cff0514ef289720cc13e375ba8, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.623968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.636200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.636850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.637130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.637403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.707579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.709685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.732031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 131/265] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:52 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/f96702cff0514ef289720cc13e375ba8/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:52.733279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.815683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 135/266] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:52.821904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:52.926849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f208f7-34aa-425e-b751-ec21deca89b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.963583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:52.964463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:52.964745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:52.965019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:52.966251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:52.967709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:52.969689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 136/267] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:52.972505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94effc3-ebf8-40e6-84e4-5ab0fd26db1f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:52.975625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:53.074328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:53.075024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.075313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.075600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.076448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=6eead9b767e34f0c94348433c1aff30a) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:53.076785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:53.078304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0a4e-0da6-4c8a-99de-e6b16f950ab7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:53.085507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e740-c3c8-4e55-b5df-d4f1a5a2d02c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:53.092265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 132/268] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/role_assignments?user.id=6eead9b767e34f0c94348433c1aff30a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:53.122328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:53.123048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.123346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.123605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.124475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=6eead9b767e34f0c94348433c1aff30a) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:53.124781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:53.126319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913ab7-ad7f-45c9-a33c-d39cb61f84ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:53.133734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 137/269] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:52 2022] GET /identity/v3/role_assignments?user.id=6eead9b767e34f0c94348433c1aff30a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=ace62a47cba3428196ca1286882b1fae => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:53.506606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5eda-7799-4abd-ac24-d90451d6e182 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.507313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5eda-7799-4abd-ac24-d90451d6e182 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.507800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c5eda-7799-4abd-ac24-d90451d6e182 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.509995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 133/270] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:53.516071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ff89-621f-4209-b255-895b65bba597 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.516699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ff89-621f-4209-b255-895b65bba597 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.517173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ff89-621f-4209-b255-895b65bba597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.538014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f675ff89-621f-4209-b255-895b65bba597 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:53.539532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f675ff89-621f-4209-b255-895b65bba597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:53.613322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:53.639629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5eda-7799-4abd-ac24-d90451d6e182 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:53.753649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c5eda-7799-4abd-ac24-d90451d6e182 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:53.788652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:53.789461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.789743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.790014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.800201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:53.807091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-8e6da2ea-86b5-42a6-a5b7-0b431ec0c42d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:53.808291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 134/272] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:53.814092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ff89-621f-4209-b255-895b65bba597 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:53.893254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd74ac-382a-4772-9446-4ea04d83c001 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.893990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd74ac-382a-4772-9446-4ea04d83c001 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.894484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd74ac-382a-4772-9446-4ea04d83c001 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.897256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 135/273] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:53.902414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027eea5-f63e-4003-9e40-4da0bcfd70ba None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.902948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027eea5-f63e-4003-9e40-4da0bcfd70ba None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.903454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027eea5-f63e-4003-9e40-4da0bcfd70ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.915219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ff89-621f-4209-b255-895b65bba597 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:53.923666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e027eea5-f63e-4003-9e40-4da0bcfd70ba None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:53.924845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e027eea5-f63e-4003-9e40-4da0bcfd70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:53.948579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:53.949238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.949543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.949816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.950554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:53.951143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:53.952322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f41e67-b595-4b12-ab09-c16b9c0663c1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:53.961377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 139/274] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:53.966473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7bee-5344-433e-b9b7-bedd37959231 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.966763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7bee-5344-433e-b9b7-bedd37959231 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.967040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7bee-5344-433e-b9b7-bedd37959231 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:53.968869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 140/275] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:53.970095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc7bee-5344-433e-b9b7-bedd37959231 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:53.993477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 136/276] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:53.993754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:53.994251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:53.994526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.018893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:54.020203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:54.078094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc7bee-5344-433e-b9b7-bedd37959231 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.088068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:54.088745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.114888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.116132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.116608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.117078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] PATH_INFO: `/v3/users/b17af8a7ea7e41a6973939dfa0257f60` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.134042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b17af8a7ea7e41a6973939dfa0257f60)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.135767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.138160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 141/278] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:53 2022] GET /identity/v3/users/b17af8a7ea7e41a6973939dfa0257f60 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:54.138990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.193594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6b228-4256-42bb-828c-4aeb278c9be1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.228842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.229661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.229951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.230203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.238547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53750879-5ac4-4853-ba61-99bfed4549b0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.240306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:54.247221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:54.249481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 138/279] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:54.249481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.276793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.277611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.277886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.278156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.279307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.280748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.286834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 142/280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:54.286834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.353013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b1e1-64ba-4a31-8e75-6af4227b33a9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.384460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69165964-5a3f-4f87-8efb-a725b34c1af7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.392776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.393523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.393868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.394202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.395091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, user.id=b17af8a7ea7e41a6973939dfa0257f60, scope.system=all) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:54.395492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.397606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.402484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 139/281] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/role_assignments?user.id=b17af8a7ea7e41a6973939dfa0257f60&scope.system=all&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:54.407094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.434187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.434878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.435167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.435445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.436226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:54.436532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.438074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.448707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 143/282] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:54.454537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.538294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe08b-97d3-4c9e-885d-30b8e1ea0280 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.572385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8b404-c4de-4937-9f60-a63c3bda5e39 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.574768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.575531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.576659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.576659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.576850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.578527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.609352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.610246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.610527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.610803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] PATH_INFO: `/v3/users/922ebcbd869b473499af3978fafce573` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.611998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] RBAC: Authorizing `identity:get_user(user_id=922ebcbd869b473499af3978fafce573)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.613478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.615652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 144/283] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/users/922ebcbd869b473499af3978fafce573 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:54.621107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.673767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 140/284] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:44:54 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:54.725531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425382-7c83-4ada-9e88-9af57b04cdcd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.763271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.764147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.764425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.764700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.765991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.767556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f564e-3f24-4394-8763-4f93e3c3f63c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:54.773583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 145/285] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:54 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:54.777820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:54.885784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16552-f075-4953-ac47-7f2a73e1470c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:54.922530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:54.923448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:54.923768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:54.924068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/922ebcbd869b473499af3978fafce573/roles/2703ba06ba7d48b385ad98fb267e49f8` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:54.926188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, user_id=922ebcbd869b473499af3978fafce573, role_id=2703ba06ba7d48b385ad98fb267e49f8)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:54.928297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138d96-5b60-494d-9a71-f57fdb5790d2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:55.010278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 141/286] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:44:54 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/users/922ebcbd869b473499af3978fafce573/roles/2703ba06ba7d48b385ad98fb267e49f8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:55.757940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799e7ba-3444-4f2c-8782-3ab66142708a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:55.758961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799e7ba-3444-4f2c-8782-3ab66142708a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:55.759453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799e7ba-3444-4f2c-8782-3ab66142708a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:55.761492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 146/287] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:55.766914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:55.767738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:55.768262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:55.786943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:55.788472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:55.857033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 142/288] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:55.881077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799e7ba-3444-4f2c-8782-3ab66142708a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:55.986884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799e7ba-3444-4f2c-8782-3ab66142708a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.021952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.023060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.023543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.024041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.035158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:56.042749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:56.044599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 147/289] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:56.050607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:56.153584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d8b3-3f4c-4162-a661-b53d709cb676 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.187897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.188924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.189418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.190040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.191028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:56.191545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:56.193737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:56.202848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 143/290] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:56.208909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:56.316524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a90d8a-11b7-4ad6-a64f-364ca1cbd426 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.358400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.359628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.360124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.360619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] PATH_INFO: `/v3/users/f96702cff0514ef289720cc13e375ba8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.362060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] RBAC: Authorizing `identity:get_user(user_id=f96702cff0514ef289720cc13e375ba8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:56.363830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:56.369508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 148/291] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:56 2022] GET /identity/v3/users/f96702cff0514ef289720cc13e375ba8 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:56.372109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:56.486450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e03fc-cc48-4f2a-98fd-44da51034d5b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.521691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.522668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.523204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.523690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.591902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:56.593725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:56.694068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 144/292] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:44:56.699933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:56.801911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58632213-2fc7-4ff9-9dba-751947a9dc60 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.837252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.838556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.839042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.839539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.841184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:56.843080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c130-12b1-4ac8-bcab-60b9a7815f58 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:56.849577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 149/293] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:56 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:56.852745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:56.954510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95e0c-b3fa-490c-8598-c53dd068c867 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:56.990458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:56.991514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:56.991997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:56.992494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:56.993582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=f96702cff0514ef289720cc13e375ba8) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:56.994107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:56.995806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d22ee-0338-43fd-8104-f49b6e0957b4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:57.002095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 145/294] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:56 2022] GET /identity/v3/role_assignments?user.id=f96702cff0514ef289720cc13e375ba8&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:57.290066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91263-5f2a-441f-bf0c-cde04d6667fe None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.290461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91263-5f2a-441f-bf0c-cde04d6667fe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.290656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91263-5f2a-441f-bf0c-cde04d6667fe None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.292698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 150/295] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:57.298163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.298699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.298980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.322474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:57.323941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:57.422142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 146/296] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:57.447956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b91263-5f2a-441f-bf0c-cde04d6667fe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:57.569080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b91263-5f2a-441f-bf0c-cde04d6667fe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:57.602596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:57.603788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.604318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.604789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.615902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:57.623255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-62ae0d4a-0ad7-4d5e-85e0-221d8338fd46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:44:57.629205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 151/297] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:57.631731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:57.764867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb210-ba75-4b48-8118-01650a41a9a3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.765213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb210-ba75-4b48-8118-01650a41a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.765452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb210-ba75-4b48-8118-01650a41a9a3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.767619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 152/298] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:57.773601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358404-23e5-4ee0-a751-9a8a7d7fb6ff None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.773885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358404-23e5-4ee0-a751-9a8a7d7fb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.774170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358404-23e5-4ee0-a751-9a8a7d7fb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.792158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ed358404-23e5-4ee0-a751-9a8a7d7fb6ff None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:57.793357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ed358404-23e5-4ee0-a751-9a8a7d7fb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:57.851190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fca64-8b52-4f03-b8d8-8af98b9469ed None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:57.862559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 153/299] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:57.864540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139e3-cc32-482a-a8ba-00ba148a7e84 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.864831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139e3-cc32-482a-a8ba-00ba148a7e84 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.865107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139e3-cc32-482a-a8ba-00ba148a7e84 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.867124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 154/300] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:57.872021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.872310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.872602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.889369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:57.890874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:57.891758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:57.892446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:57.892731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:57.893065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:57.893851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:57.894208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:57.895620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:57.903971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 147/301] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:57.904618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:57.956360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 155/302] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:44:57.957693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.007538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e85dde-2e29-445b-a5e6-d2038b0afb7f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.040206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.041007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.041287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.041601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.051882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:58.058767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:58.059936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 148/303] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:58.060699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.062127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe9ab8-01a9-44c2-8a06-82fc48cec85f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.095590 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.096460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.096742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.097018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] PATH_INFO: `/v3/users/b17af8a7ea7e41a6973939dfa0257f60` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.098744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] RBAC: Authorizing `identity:get_user(user_id=b17af8a7ea7e41a6973939dfa0257f60)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.100188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0f652-8cef-4038-823e-64635c957d6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.101878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 156/304] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:57 2022] GET /identity/v3/users/b17af8a7ea7e41a6973939dfa0257f60 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:58.102983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7318-f60f-4a0c-9582-d909b092b526 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.103266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7318-f60f-4a0c-9582-d909b092b526 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.103543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7318-f60f-4a0c-9582-d909b092b526 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.105168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 157/305] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:44:58.106523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7318-f60f-4a0c-9582-d909b092b526 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.158969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c4ca-fe68-47ba-b9ec-795d5d585c3b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.191692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.192520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.192801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.193077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.194295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.195728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.197312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 149/306] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:58.198090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.200482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7318-f60f-4a0c-9582-d909b092b526 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.233284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.233964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.234244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.234517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.235265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:58.235566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.236931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de129-36c7-4cf4-b9d8-b47e794ec14b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.244558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 158/307] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:58.245807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.246093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.246365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.261952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:44:58.263116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:44:58.292912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c1f10-694d-4826-b95f-117795d6b81f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.326855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.327707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.327990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.328266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] PATH_INFO: `/v3/system/users/b17af8a7ea7e41a6973939dfa0257f60/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.329764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b17af8a7ea7e41a6973939dfa0257f60, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.330166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 159/308] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:44:58.331398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.334141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.428363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113a663-d01d-40f9-a29a-33d82e926387 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.438376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 150/309] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Aug 23 05:44:58 2022] PUT /identity/v3/system/users/b17af8a7ea7e41a6973939dfa0257f60/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:44:58.439326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.463945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.464979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.465255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.465714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.466419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.467909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.530091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 160/310] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Aug 23 05:44:58 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:44:58.531117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.562829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dbb33-8e23-4cad-9fdd-ac606a5ce806 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.602553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.603571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.603959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.604307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] PATH_INFO: `/v3/users/c6b953db98a04d69b5aa4800b4aceb31` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.619957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=c6b953db98a04d69b5aa4800b4aceb31)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.621463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.623646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 151/311] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/users/c6b953db98a04d69b5aa4800b4aceb31 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:58.629828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.662407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119caf0-8db4-4715-959a-4cdd23684ef9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.698570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.699452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.699735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.700009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.714991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:44:58.723230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:44:58.724472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 161/312] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:44:58.730346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:58.763556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bfa48-6678-4676-82f4-d5dafd40f3c5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.806820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.807872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.808364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.808833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.809919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, user.id=c6b953db98a04d69b5aa4800b4aceb31, scope.system=all) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:58.810444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.812264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.818685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 152/313] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/role_assignments?user.id=c6b953db98a04d69b5aa4800b4aceb31&scope.system=all&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:44:58.838385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6997-f9dd-484e-9d9b-0e6967c89783 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:58.877332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:58.878940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:58.879496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:58.879988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:58.880976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:58.881523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:58.883176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:58.893561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 162/314] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:58.905496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:59.012096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89086f-f4aa-4b14-b6e3-b172510c0302 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:59.052796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:59.053692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:59.053975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:59.054248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] PATH_INFO: `/v3/users/922ebcbd869b473499af3978fafce573` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:59.055439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] RBAC: Authorizing `identity:get_user(user_id=922ebcbd869b473499af3978fafce573)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:59.056878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:59.058822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 153/315] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:44:58 2022] GET /identity/v3/users/922ebcbd869b473499af3978fafce573 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:59.064202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:59.164767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc73ee-c5b2-48e5-8a9d-59f518c8f578 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:59.197788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:59.198444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:59.198724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:59.198998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:59.387464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:59.388954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:59.486303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 163/316] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:44:59.491919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:59.592108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa0408-844a-428c-bbbe-b1fa16aa055b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:59.625987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:59.626856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:59.627137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:59.627412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:59.628649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:59.630702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1bb0-35e8-4b62-a25f-1734989a8ac7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:59.632894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 154/317] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:44:59 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:44:59.638853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:44:59.739486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd291-5b50-460c-8879-aab706db34a5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:44:59.775061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:44:59.775719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:44:59.776000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:44:59.776266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:44:59.777099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, scope.project.id=b2c901f308ac4cb5a886d5753a418090, user.id=922ebcbd869b473499af3978fafce573) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:44:59.777406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:44:59.778880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395be500-420e-4d55-8432-1f1e0887e958 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:44:59.785223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 164/318] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:44:59 2022] GET /identity/v3/role_assignments?user.id=922ebcbd869b473499af3978fafce573&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:00.845864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab7845-3baa-4fc2-80ed-d590b920eeca None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:00.846376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab7845-3baa-4fc2-80ed-d590b920eeca None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:00.846474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab7845-3baa-4fc2-80ed-d590b920eeca None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:00.848370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 155/319] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:00.853406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8922-0719-4f61-8b31-880f37c80ebf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:00.853813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8922-0719-4f61-8b31-880f37c80ebf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:00.854004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8922-0719-4f61-8b31-880f37c80ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:00.870551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7e3c8922-0719-4f61-8b31-880f37c80ebf None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:00.871719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7e3c8922-0719-4f61-8b31-880f37c80ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:00.934348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 165/320] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:00.958502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab7845-3baa-4fc2-80ed-d590b920eeca None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:00.970151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cca4-46c0-4b77-b484-b0178ffd098b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:00.970437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cca4-46c0-4b77-b484-b0178ffd098b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:00.970709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cca4-46c0-4b77-b484-b0178ffd098b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:00.972588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 166/321] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:00.977139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:00.977419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:00.977719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:00.993941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:00.995100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:01.057043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab7845-3baa-4fc2-80ed-d590b920eeca None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.059823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 167/322] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:01.083542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.092504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.093286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.093607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.093880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.103935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:01.110740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:01.111938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 156/323] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:01.117409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.184170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edcfc-d194-41f3-94d8-47b090bd380d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.213306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92173c0-5838-4b88-af4c-2f97cb6d06ec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.216250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.217025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.217304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.217610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.218762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.220203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6eea7-2029-4e60-b12f-fb3941e83bcb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.221826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 168/324] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:01.223070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee9a7-f656-44f3-a747-7ea89d2825de None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.223419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee9a7-f656-44f3-a747-7ea89d2825de None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.223699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee9a7-f656-44f3-a747-7ea89d2825de None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.225315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 169/325] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:01.227643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee9a7-f656-44f3-a747-7ea89d2825de None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.246752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.247403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.247673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.247944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.248673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:01.248974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.250353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc6ce1-1f54-4a8c-924e-bf360898051a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.258666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 157/326] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:01.263219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.263219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.263219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.277400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:01.278579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:01.323052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee9a7-f656-44f3-a747-7ea89d2825de None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.339944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 158/327] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:01.340745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.358104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.358684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.358963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.359232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] PATH_INFO: `/v3/groups` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.359918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.361358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.434911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327588a-2200-4b8a-a2af-eec8aa80be0a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.465616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 170/328] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Aug 23 05:45:01 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:45:01.466439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.468777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.468777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.468777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.468777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] PATH_INFO: `/v3/users/b17af8a7ea7e41a6973939dfa0257f60` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.469925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] RBAC: Authorizing `identity:get_user(user_id=b17af8a7ea7e41a6973939dfa0257f60)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.471440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.473378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 159/329] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/users/b17af8a7ea7e41a6973939dfa0257f60 => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:01.479300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.571907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae2e7-af43-4439-ae6c-21a8c3e5552e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.583194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21115-0623-45a4-88f2-fd6f7300233d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.606978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.607776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.608054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.608381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.619850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.620069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:01.620851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.621275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.621719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.622713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] RBAC: Adding query filter params (role.id=7b64cf89ada244d0a86bb5e4c176ed63, user.id=b17af8a7ea7e41a6973939dfa0257f60, scope.system=all) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:01.623165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.624760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.626915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:45:01.628153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 171/330] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:01.634218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.638580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 160/331] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/role_assignments?user.id=b17af8a7ea7e41a6973939dfa0257f60&scope.system=all&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:01.744866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b529-1979-4159-ab23-88983c3cbe23 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.780430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.781111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.781408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.781698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.782473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:01.782773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.784189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.794184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 172/332] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:01.800323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:01.905028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a095bb5-0f28-4573-add2-fdc4ddca3f6a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:01.940556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:01.941500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:01.941782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:01.942051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] PATH_INFO: `/v3/users/c6b953db98a04d69b5aa4800b4aceb31` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:01.943307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] RBAC: Authorizing `identity:get_user(user_id=c6b953db98a04d69b5aa4800b4aceb31)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:01.944734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf750e14-491a-481a-b6a4-529c73218b2d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:01.946728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 161/333] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:45:01 2022] GET /identity/v3/users/c6b953db98a04d69b5aa4800b4aceb31 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:01.952066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:02.063448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec002-a45b-4a87-bf3d-261050ded924 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:02.100987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:02.101875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:02.102151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:02.102488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] PATH_INFO: `/v3/system/users/c6b953db98a04d69b5aa4800b4aceb31/roles/2703ba06ba7d48b385ad98fb267e49f8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:02.104029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c6b953db98a04d69b5aa4800b4aceb31, role_id=2703ba06ba7d48b385ad98fb267e49f8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:02.105393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017de3c-8941-47b9-a842-d2d3de3e45af None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:02.198668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 173/334] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Aug 23 05:45:01 2022] PUT /identity/v3/system/users/c6b953db98a04d69b5aa4800b4aceb31/roles/2703ba06ba7d48b385ad98fb267e49f8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 05:45:04.387399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff42d-fa39-45ec-a99f-f05501ee4b58 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.388290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff42d-fa39-45ec-a99f-f05501ee4b58 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.388879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff42d-fa39-45ec-a99f-f05501ee4b58 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.391203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 162/335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:04.397393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745819-26b1-40db-b663-2baff5191844 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.398338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745819-26b1-40db-b663-2baff5191844 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.398810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745819-26b1-40db-b663-2baff5191844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.421923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e745819-26b1-40db-b663-2baff5191844 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:04.423423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e745819-26b1-40db-b663-2baff5191844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:04.540581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 174/336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:04.600576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff42d-fa39-45ec-a99f-f05501ee4b58 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:04.719809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff42d-fa39-45ec-a99f-f05501ee4b58 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:04.757726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:04.758557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.758840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.759115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.773031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:04.780278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-851ceccc-58a6-431c-a678-8253b705a53d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:04.781892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 163/337] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:04.787338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e745819-26b1-40db-b663-2baff5191844 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:04.794616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c174ba-6299-43fc-a27f-1da3d25438e1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.794912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c174ba-6299-43fc-a27f-1da3d25438e1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.795174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c174ba-6299-43fc-a27f-1da3d25438e1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.797148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 164/338] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:04.815246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.815538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.816312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.846553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:04.847822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:04.940032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 165/339] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:04.942606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e745819-26b1-40db-b663-2baff5191844 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:04.990502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:04.991092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:04.991373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:04.991642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:04.992390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:04.992692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:05.002292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:05.011948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 175/340] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:05.018855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.019298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.151121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8343-40ce-4eb9-8bbe-0a4cdd2e44b9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.195214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.196188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.196651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.197095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.212753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adb4ca-ba04-4009-a5e2-0a8a9d29b4c2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.282963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.284054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.284532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.285040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.310800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:05.311820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:05.313522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68858c1d-de1f-4e02-a337-a7dae59bcf6a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:05.318013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-fdfa9496-db58-4200-bcf1-545e6a7539a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:05.320263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 176/341] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:05.321679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238a29-3c6a-4d68-867a-d9e4ca46f924 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.322094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238a29-3c6a-4d68-867a-d9e4ca46f924 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.322534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238a29-3c6a-4d68-867a-d9e4ca46f924 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.324667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 177/342] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:05.327049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c238a29-3c6a-4d68-867a-d9e4ca46f924 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.466137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 166/343] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:05.468166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.468661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.469560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.472707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c238a29-3c6a-4d68-867a-d9e4ca46f924 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.511318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:05.515046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:05.546404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.547351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.549067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.549556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.551050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:05.555672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:05.557323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:05.574938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 178/344] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:05.576081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.632088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 167/345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:05.632949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.691292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5552f30-2d75-4518-8c79-10c2d688e6c4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.732362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.733626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.734166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.734655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.742269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:05.742617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b0537-e436-450f-8cf7-a52c49d25aab None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.744184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:05.746269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 179/346] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:05.747170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.786728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.787624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.788039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.788474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.866353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:05.868042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd69d-f0f2-4eda-b83c-76aa0a455085 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:05.911972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125333c-025b-4178-98ff-bcd4e286b34f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:05.955215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:05.957517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.957973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.958414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.975230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:05.983990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:05.985219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 180/347] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:05.986256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:05.989135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 168/348] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:05.990970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20bc9-b440-4fab-84cc-286f00170530 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.991256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20bc9-b440-4fab-84cc-286f00170530 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.991528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f20bc9-b440-4fab-84cc-286f00170530 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.993331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 169/349] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:05.995284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81d9b-25a8-4f12-ab36-dbf125c42fbd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:05.995765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81d9b-25a8-4f12-ab36-dbf125c42fbd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:05.996208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81d9b-25a8-4f12-ab36-dbf125c42fbd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:05.998105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 170/350] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:05.999029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81d9b-25a8-4f12-ab36-dbf125c42fbd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.128922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81d9b-25a8-4f12-ab36-dbf125c42fbd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.134038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6209d-bb97-464a-9adc-efe3c10240cc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.170353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.171031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.171314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.171591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.172680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:06.172994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.174401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.177712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.178842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.179208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.179553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.185519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 171/351] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:06.186680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.192387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.194171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840eaf4-722b-4efa-a985-71e39a832d16 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.195871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 181/352] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:05 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:06.197330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d15e-f05c-49a9-a465-89cbf736b648 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.197810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d15e-f05c-49a9-a465-89cbf736b648 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.198230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d15e-f05c-49a9-a465-89cbf736b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.223052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4131d15e-f05c-49a9-a465-89cbf736b648 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:06.224998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4131d15e-f05c-49a9-a465-89cbf736b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:06.306301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 182/353] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:06.308028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.308507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.308962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.313732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51dc11-d6b5-4193-b807-0db58f2963cd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.328421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:06.330172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:06.356457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.357318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.357834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.358116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.359320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.360898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.362881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 172/354] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:06.363722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.406991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 183/355] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:06.408049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.469978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98180565-272a-4501-891e-40fa3cfb783c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.506870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.507766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.508049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.508483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.515478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6591a9-57f7-47e5-93b9-5889169f8263 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.556263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.556919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.557197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.557540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.558546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=06fc65a8101d4011b29fe6eff82786ba) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:06.558861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.560304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.566858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 184/356] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:06.567902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.579526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.581019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0634e2-d7a2-4aae-8afa-2cc21034cce7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.696898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 173/357] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:06.698229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbe43-92a8-4c12-8138-391751f3178e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.698516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbe43-92a8-4c12-8138-391751f3178e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.698791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbe43-92a8-4c12-8138-391751f3178e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.700798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 174/358] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:06.701532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddbe43-92a8-4c12-8138-391751f3178e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.718579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307319-f6b1-4c5d-8f97-eff5ba779db8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.767354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.768159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.768441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.768824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.781563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:06.788646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 05:45:06.790187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 185/359] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:06.791121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.811828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddbe43-92a8-4c12-8138-391751f3178e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.851070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.851938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.853006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.853292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.854555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:06.856107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:06.863391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 175/360] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:06.864382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:06.926782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8082-4e9a-45cc-b3b4-c942d11772d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.966772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:06.967579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.967861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.968139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:06.974386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd72a6-c89f-4e96-9726-8d2f3e053652 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:06.980738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:06.988905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-82a7483c-998e-400f-b42a-9ecadbc87383 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:06.990576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 186/361] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:06.992098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:06.992395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:06.992677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.011745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:07.012926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:07.020655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.021531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.022424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.022706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.024221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.025542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.027335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 176/362] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:06 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.028105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.109544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 187/363] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:07.110378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.144664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb6a4-034b-430c-88ba-c5855e05c995 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.189902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.191692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.192205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.192668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.193627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:07.194121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.195701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.204620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 177/364] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.205726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.235788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f751611-ff15-42df-bd0c-f4d992b23096 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.278938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.279595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.279875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.280314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.280981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=b2c901f308ac4cb5a886d5753a418090) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:07.281290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.283292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.289579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 188/365] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.290543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.337920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca361de-3a09-4273-a022-913be497c1c3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.375163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.376250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.376727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.377199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.378362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:07.378881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.380510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.390441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 178/366] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.391625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.417759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c31e0f-8e97-421e-9320-4c2a8b573b20 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.454323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.455536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.456042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.457061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.458691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.460425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.462376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 189/367] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.463388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.501486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef469f-e137-4b46-b273-a1ab95005123 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.535854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.536906 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.537336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.537779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.548497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:07.556686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:07.559590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 179/368] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:07.560586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.566625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836daf3-b574-4188-9f9c-45fb86207444 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.601700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.602830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.603317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.603787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] PATH_INFO: `/v3/users/c6b953db98a04d69b5aa4800b4aceb31` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.605198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] RBAC: Authorizing `identity:get_user(user_id=c6b953db98a04d69b5aa4800b4aceb31)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.606867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.608758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 190/369] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/users/c6b953db98a04d69b5aa4800b4aceb31 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.609726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.673274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa792-a74e-456f-8be0-e7859586278c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.708015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.708890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.709336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.709855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.721151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ad8c7-0b88-4cc9-8c3c-39c8fc5a213c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.755710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.756216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.756493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.756761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.757700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=06fc65a8101d4011b29fe6eff82786ba) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:07.757924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.759418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.764897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 191/370] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=ace62a47cba3428196ca1286882b1fae => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.765709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.781569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.783369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.871693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa4aa-1260-4b6d-b293-6f5773386706 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:07.894507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 180/371] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:07.895775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:07.908226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:07.908894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:07.909736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:07.910016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:07.910898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:07.911149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:07.912527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:07.921369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 192/372] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:07.922217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.000806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92cce8-616e-42fd-891e-91da1babeb81 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.024937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85567f9c-142e-4dad-bc1c-a9a598b765eb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.036739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.037787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.038282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.038746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.039756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] RBAC: Adding query filter params (role.id=2703ba06ba7d48b385ad98fb267e49f8, user.id=c6b953db98a04d69b5aa4800b4aceb31, scope.system=all) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:08.040254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.041909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.054070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 181/373] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/role_assignments?user.id=c6b953db98a04d69b5aa4800b4aceb31&scope.system=all&role.id=2703ba06ba7d48b385ad98fb267e49f8 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:08.055202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.063186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.064088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.064368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.064642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.067223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.068572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.070419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 193/374] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:07 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:08.076170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.246084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaabc8-51de-4443-99a3-249a286efa05 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.261049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc668bc-590d-4191-8349-6f9ace0dc4c0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.282245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.283035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.283313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.283654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.285370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.286854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.288811 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 194/375] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:08.301533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.331689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.332345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.332626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.332901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.414245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.416042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.526116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 182/376] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:08.532198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.551692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351326f2-4f9f-4b3d-9584-2b9de667ef3d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.640646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16a40-2d03-4f45-b73b-cb6e9185d057 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.645667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.646335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.646614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.646887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.647720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=b2c901f308ac4cb5a886d5753a418090) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:08.648026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.653545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.661653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 195/377] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=ace62a47cba3428196ca1286882b1fae => generated 260 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:08.679910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.681157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.681719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.682188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] PATH_INFO: `/v3/projects/3869decee235490cb9b23376a9ec23ec` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.683727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] RBAC: Authorizing `identity:get_project(project_id=3869decee235490cb9b23376a9ec23ec)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.685488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.687787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 183/378] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/projects/3869decee235490cb9b23376a9ec23ec => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:08.695169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:08.840067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9f1b9-53f2-416d-973c-bd2752ffa6a0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:08.877654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:08.878586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:08.878867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:08.879140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] PATH_INFO: `/v3/groups/dc5c27e41bf24ce9b745dac480ec5355` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:08.890712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] RBAC: Authorizing `identity:get_group(group_id=dc5c27e41bf24ce9b745dac480ec5355)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:08.892195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41b8cd-aa51-49ab-97a8-c317ff8c519d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:08.895306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 196/379] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/groups/dc5c27e41bf24ce9b745dac480ec5355 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:08.901526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:09.015219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2875d3-767e-4dd8-93e4-f6d6cb6e6b6c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:09.049888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:09.050537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:09.050816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:09.051089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:09.051915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] RBAC: Adding query filter params (group.id=dc5c27e41bf24ce9b745dac480ec5355, role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=3869decee235490cb9b23376a9ec23ec) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:09.052220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:09.053660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b67af-cb88-431a-bf1c-71a6472f6656 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:09.059714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 184/380] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:08 2022] GET /identity/v3/role_assignments?group.id=dc5c27e41bf24ce9b745dac480ec5355&scope.project.id=3869decee235490cb9b23376a9ec23ec&role.id=0b140cf23eea4013a92d34840813e9cf => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:09.358898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3771-2d9f-480f-aa2f-711632d9edb8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:09.359187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3771-2d9f-480f-aa2f-711632d9edb8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:09.359475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c3771-2d9f-480f-aa2f-711632d9edb8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:09.361574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 197/381] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:09.368778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:09.369075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:09.369359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:09.397598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:09.398792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:09.491543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 185/382] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:09.521326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c3771-2d9f-480f-aa2f-711632d9edb8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:09.629846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c3771-2d9f-480f-aa2f-711632d9edb8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:09.664480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:09.665274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:09.665593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:09.665866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:09.679707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:09.686738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:09.692469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 198/383] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:09.693693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:09.817592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8800-0513-4a38-98a5-7d1e6097a57f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:09.866136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:09.866823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:09.867109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:09.867386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:09.868141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:09.868448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:09.869851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:09.878584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 186/384] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:09.884544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:10.008620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11c25-71d8-48f1-900f-1980301bf29d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:10.041950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:10.042800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:10.043075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:10.043345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:10.044499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:10.045975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:10.047855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 199/385] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:09 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:10.053786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:10.208215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04137-f09c-4485-8b8a-4ab1fc4ad8d5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:10.258140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:10.259015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:10.259299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:10.259574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:10.260807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:10.262284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85c4ac-61d7-4146-822c-ec27caa6d05e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:10.264321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 187/386] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:10 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:10.269886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:10.431744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce1b6-21df-47f7-b42c-2f74d61f10ba None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:10.475127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:10.476008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:10.476284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:10.476559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/groups/1c9b92c3b1c3423f985815b615a9376a/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:10.482701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, group_id=1c9b92c3b1c3423f985815b615a9376a, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:10.484143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5094eb-a9f9-4e5e-8ab0-c8f2d59fb5e2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:10.562236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 200/387] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Aug 23 05:45:10 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/groups/1c9b92c3b1c3423f985815b615a9376a/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:10.789995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda212c3-76c6-441f-8e4b-99ddb1fe759b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:10.789995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda212c3-76c6-441f-8e4b-99ddb1fe759b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:10.789995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda212c3-76c6-441f-8e4b-99ddb1fe759b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:10.792085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 188/388] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:10.797556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:10.797961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:10.798309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:10.817010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:10.818228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:10.889550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 201/389] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:10.909754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda212c3-76c6-441f-8e4b-99ddb1fe759b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.030136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda212c3-76c6-441f-8e4b-99ddb1fe759b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.064611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.065425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.065746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.066020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.076723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:11.084539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-349e3b30-5571-4cf1-a07f-79c530784e59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:11.089542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 189/390] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:11.091948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.130071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4be4a-77ff-49e1-bd36-a620ced0f99b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.130721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4be4a-77ff-49e1-bd36-a620ced0f99b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.131196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4be4a-77ff-49e1-bd36-a620ced0f99b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.137339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 190/391] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:11.139116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.139658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.140135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.158050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:11.160172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:11.210420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645fa4-1e86-4c2c-9447-4ef781b34c09 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.247233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 191/392] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:11.257732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.258495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.258780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.259054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.259876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:11.260180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.261636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.273989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 202/393] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:11.279818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.315845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.405940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2a10-2524-4512-91bc-07cc67811f12 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.421637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a494efc-3950-4e70-9953-7f1880a3d2c2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.454659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.456891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.457823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.458612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.459952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.461546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.462370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.464014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.464498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.464977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.467532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 192/394] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:11.473930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.488933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:11.500335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:11.502204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 203/395] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:11.507585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.625890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76187d5-8084-47de-8033-748331dcad29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.640693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee689b-248a-4fd2-9e01-d4b1f4525798 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.659676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.660530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.660805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.661074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.662345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.663839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb826b0-90a9-409a-a45d-1964657a9009 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.665895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 193/396] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:11.667087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeefa4-d04e-4ec9-a7d8-a5ae224d583c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.667367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeefa4-d04e-4ec9-a7d8-a5ae224d583c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.667639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeefa4-d04e-4ec9-a7d8-a5ae224d583c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.669587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 194/397] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:11.673550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeefa4-d04e-4ec9-a7d8-a5ae224d583c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.683247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.684132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.684241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.684501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.685260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:11.685601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.687056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f33ecd-812f-4495-beef-4980c4f9b29f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.695834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 204/398] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:11.701052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.701052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.701052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.717652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:11.718856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:11.789920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeefa4-d04e-4ec9-a7d8-a5ae224d583c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.793542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 205/399] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:11.794453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.842085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.843650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.844126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.844612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/groups/1c9b92c3b1c3423f985815b615a9376a/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.847408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, group_id=1c9b92c3b1c3423f985815b615a9376a, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.849182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.896744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564524d-b2f2-48f3-8baf-f12077de7edc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:11.929607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:11.930454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:11.930778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:11.931054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:11.932234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:11.933692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:11.940193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 206/400] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:11.940193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:11.956500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 195/401] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Aug 23 05:45:11 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/groups/1c9b92c3b1c3423f985815b615a9376a/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 05:45:11.957323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.055550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333cf2-fa73-4d91-b0cc-919938c36afe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.077397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62f6e-60a0-4e32-b95b-31f7491b6b01 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.093694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.094568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.094850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.095119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.106760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:12.114524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-b322eef1-7fef-473e-aae6-74c4cebfd96d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:12.120364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 207/402] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:12.120364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57912-51e3-4a11-b510-99d068130c04 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.120364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57912-51e3-4a11-b510-99d068130c04 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.120364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57912-51e3-4a11-b510-99d068130c04 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.120364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 208/403] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:12.121700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57912-51e3-4a11-b510-99d068130c04 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.128703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.129842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.130265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.130678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.132115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.133744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5f4d2-f969-4a45-9f2c-53bd02fffd4f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.140535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 196/404] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:11 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:12.142207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.142715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.143767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.161884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:12.163400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:12.234784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57912-51e3-4a11-b510-99d068130c04 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.250342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 197/405] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:12.251898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.270941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.271833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.272324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.272666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.273596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:12.274009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.275541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.285153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 209/406] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:12.286054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.378294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef83f-e079-4068-a772-f67e0f7dc31b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.411785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec759d9-cb72-40c0-9be5-f3b096168f1e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.420146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.421630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.422406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.422857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba/groups/1c9b92c3b1c3423f985815b615a9376a/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.426570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] RBAC: Authorizing `identity:create_grant(project_id=06fc65a8101d4011b29fe6eff82786ba, group_id=1c9b92c3b1c3423f985815b615a9376a, role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.428632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.446102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.446978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.447327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.447669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.457805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:12.464715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:12.466075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 210/407] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:12.466656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.536827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 198/408] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Aug 23 05:45:12 2022] PUT /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba/groups/1c9b92c3b1c3423f985815b615a9376a/roles/ace62a47cba3428196ca1286882b1fae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:12.537706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.584014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae714-f59e-4124-a9c7-5302881959b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.623592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.624819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.625306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.625829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.627402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.629685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.631933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 211/409] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:12.641804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.763993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c43ad-302e-4aa0-9566-99a17ad9934c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.811946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f763a9-7dcd-4dfe-b6da-aef75b1eb150 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.812698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.813616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.814122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.814628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.816210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:12.816724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.818456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.828928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 199/410] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:12.834240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.847081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977116-5c60-4332-88f5-4e455040231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.848026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977116-5c60-4332-88f5-4e455040231c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.848305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977116-5c60-4332-88f5-4e455040231c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.848579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50977116-5c60-4332-88f5-4e455040231c None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.849803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50977116-5c60-4332-88f5-4e455040231c None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.851249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50977116-5c60-4332-88f5-4e455040231c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.853210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 212/411] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:12.859187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977116-5c60-4332-88f5-4e455040231c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.936254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81641c-7b96-4558-9fd7-6749ff8def42 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.958354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50977116-5c60-4332-88f5-4e455040231c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:12.970076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.971446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.971730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.972003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] PATH_INFO: `/v3/groups/dc5c27e41bf24ce9b745dac480ec5355` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.973188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] RBAC: Authorizing `identity:get_group(group_id=dc5c27e41bf24ce9b745dac480ec5355)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.974652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:12.976542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 200/412] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/groups/dc5c27e41bf24ce9b745dac480ec5355 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:12.981795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:12.992766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:12.993679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:12.993961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:12.994237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090/groups/1c9b92c3b1c3423f985815b615a9376a/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:12.996493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c901f308ac4cb5a886d5753a418090, group_id=1c9b92c3b1c3423f985815b615a9376a, role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:12.997991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:13.090247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e50ec-6739-47cc-9c7c-98033274f282 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:13.092698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 213/413] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Aug 23 05:45:12 2022] PUT /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090/groups/1c9b92c3b1c3423f985815b615a9376a/roles/ace62a47cba3428196ca1286882b1fae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 05:45:13.125791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:13.126661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:13.126938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:13.127258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] PATH_INFO: `/v3/projects/3869decee235490cb9b23376a9ec23ec` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:13.128632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] RBAC: Authorizing `identity:get_project(project_id=3869decee235490cb9b23376a9ec23ec)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:13.130178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1beed9-7404-477c-93c9-4076fae77495 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:13.132218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 201/414] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:12 2022] GET /identity/v3/projects/3869decee235490cb9b23376a9ec23ec => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:13.138439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:13.260578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd41ed-ea64-473f-9a42-058f20788646 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:13.297688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:13.298588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:13.298870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:13.299681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] PATH_INFO: `/v3/projects/3869decee235490cb9b23376a9ec23ec/groups/dc5c27e41bf24ce9b745dac480ec5355/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:13.301759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] RBAC: Authorizing `identity:create_grant(project_id=3869decee235490cb9b23376a9ec23ec, group_id=dc5c27e41bf24ce9b745dac480ec5355, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:13.303235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744a12-06db-4796-b150-9467fad1e089 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:13.385213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 214/415] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Aug 23 05:45:13 2022] PUT /identity/v3/projects/3869decee235490cb9b23376a9ec23ec/groups/dc5c27e41bf24ce9b745dac480ec5355/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:13.585136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86bd-901d-4a56-bec8-a62ccb45b0bd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:13.585559 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86bd-901d-4a56-bec8-a62ccb45b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:13.585732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86bd-901d-4a56-bec8-a62ccb45b0bd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:13.587516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 202/416] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:13.593196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:13.593503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:13.593784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:13.616881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:13.618117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:13.694554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 215/417] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:13.717803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f86bd-901d-4a56-bec8-a62ccb45b0bd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:13.821858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f86bd-901d-4a56-bec8-a62ccb45b0bd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:13.855415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:13.856217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:13.856496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:13.856837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:13.871443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:13.879108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:13.880698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 203/418] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:13.886431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:13.987456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe8278-fb36-43e5-89d6-ba73e662d78e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:14.021542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588daab-729a-4568-9601-a663cd917393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:14.022267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588daab-729a-4568-9601-a663cd917393 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.022552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588daab-729a-4568-9601-a663cd917393 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.022828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588daab-729a-4568-9601-a663cd917393 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.023581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588daab-729a-4568-9601-a663cd917393 None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:14.023885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588daab-729a-4568-9601-a663cd917393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:14.025261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588daab-729a-4568-9601-a663cd917393 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:14.036013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 216/419] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:14.041655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:14.164585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8cb11-855d-408f-8611-1580a22dc851 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:14.205796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:14.206510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.206797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.207068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.286912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:14.288299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:14.411014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 204/420] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:14.416462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588daab-729a-4568-9601-a663cd917393 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:14.553624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588daab-729a-4568-9601-a663cd917393 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:14.587642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:14.588869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.589347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.589843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.591337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:14.592983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee211af-788a-48a3-8c70-d015cf4f8f7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:14.595167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 217/421] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:14.601355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:14.605039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb346582-489b-4cd5-ad1b-c994ecb7dbca None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.605328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb346582-489b-4cd5-ad1b-c994ecb7dbca None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.605638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb346582-489b-4cd5-ad1b-c994ecb7dbca None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.608521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 218/422] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:14.618969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.619258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.619540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.636434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:14.637763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:14.705790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 219/423] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:14.741157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:14.830818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de314-b0da-4c66-8949-318bb81979e5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:14.872395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:14.874255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.875442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.876024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.881783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:14.883413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:14.885463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 205/424] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:14.894505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:14.907255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726841f-e5b3-4496-9ffc-acc991ec2574 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:14.946269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:14.947333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:14.947760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:14.948175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:14.964618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:14.974089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 05:45:14.980437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 220/425] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:14.982233 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.112428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c646b4-c87a-45f6-9d0d-f22df7956c49 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.150097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.151271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.151871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.152294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.153184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] RBAC: Adding query filter params (name=member) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:15.153706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:15.155224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:15.170083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 221/426] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:15.172364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.183314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1dbf-cd0d-47eb-a9da-260e4d094ffc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.258566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.260815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.263236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.263668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.266105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=06fc65a8101d4011b29fe6eff82786ba) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:15.266576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:15.271313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:15.284916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 206/427] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:14 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 611 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:15.346475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394409e9-cc4c-4ca6-a012-76685cc4901a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.399499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.400167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.400455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.400737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.500432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:15.502871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc91f3-0c1d-4633-b4bf-1e4b0733ce4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:15.603302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 222/428] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:15.608881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.696122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f087c-86bd-4099-b76d-93440dc0ad30 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.696723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f087c-86bd-4099-b76d-93440dc0ad30 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.697197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f087c-86bd-4099-b76d-93440dc0ad30 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.699202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 223/429] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:15.704565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.705125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.705628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.724831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:15.726387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:15.726590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780307d-92dc-4889-b1ac-a2a12d0e8791 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.764546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.766549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.766549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.766549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.769566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:15.771074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:15.777605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 207/430] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:15 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:15.779376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.806513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 224/431] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:15.831603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.895192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd61a-97d5-4020-a48f-1ac92e922c36 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.931289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fcfe0-a975-4f58-85d4-ea8e45ef36b7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:15.934417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.935579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.936132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.936594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.938042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:15.939724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:15.941886 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 208/432] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:15 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:15.947355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:15.975329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:15.976621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:15.977345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:15.977805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:15.991989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:16.001274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:16.003674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 225/433] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:16.009538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.057445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3cbb-73ae-4967-a0b6-3bdb3040d537 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.091650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.092398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.092767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.093108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.094027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=7b64cf89ada244d0a86bb5e4c176ed63, scope.project.id=b2c901f308ac4cb5a886d5753a418090) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:16.094452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.096605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.103021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 209/434] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:15 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=7b64cf89ada244d0a86bb5e4c176ed63 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:16.119164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01b13c-3ebe-42d4-a527-ca32e4186847 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.156985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.157730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.158541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.158812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.159573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:16.159875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.161286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b403524-8c1f-4bbc-a619-c46f21064155 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.170880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 226/435] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:16.177287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.200388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a183-43ac-4af3-b3e5-c7c563fef81a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.200574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a183-43ac-4af3-b3e5-c7c563fef81a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.200851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a183-43ac-4af3-b3e5-c7c563fef81a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.203919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 227/436] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:16.210693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f373-b6eb-4b83-99a6-94ebc704d76b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.210992 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f373-b6eb-4b83-99a6-94ebc704d76b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.211249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1f373-b6eb-4b83-99a6-94ebc704d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.235528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-08d1f373-b6eb-4b83-99a6-94ebc704d76b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:16.236806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-08d1f373-b6eb-4b83-99a6-94ebc704d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:16.303134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402600-844f-4bb5-b249-d2bc29c70a23 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.321307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 228/437] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:16.322799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcc5d6-3dc2-4106-9052-a5e947f48791 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.322914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcc5d6-3dc2-4106-9052-a5e947f48791 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.323189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcc5d6-3dc2-4106-9052-a5e947f48791 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.325818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 229/438] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:16.332206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.332492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.341509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.343700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.344342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.344619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.344890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.356956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:16.358190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:16.417896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.419355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.429418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 230/439] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:16.430201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.514259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 210/440] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:16.515088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.523720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698203-df32-40d0-a7ff-6b3a6779722a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.556120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.556897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.557181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.557480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.567678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:16.574572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:16.575741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 231/441] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:16.576499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.611980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228f79-8a74-4169-ac24-8537ec141ebb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.644058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.644847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.645125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.645395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.654852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:16.662284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:16.663445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 211/442] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:16.664188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.669886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a5d5-fec7-48af-b56a-1687ea45f563 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.701847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.702690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.702965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.703499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] PATH_INFO: `/v3/projects/06fc65a8101d4011b29fe6eff82786ba` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.704668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] RBAC: Authorizing `identity:get_project(project_id=06fc65a8101d4011b29fe6eff82786ba)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.706707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.708546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 232/443] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/projects/06fc65a8101d4011b29fe6eff82786ba => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:16.709098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.763223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb2a6-031f-40eb-bfd2-a6b1e641a3b8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.795896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.796485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.796766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.797045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.797815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:16.798120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.799504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.804004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65de4-c484-4bd5-b1f6-ca044ac1cbbe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.807163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 212/444] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:16.807945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.836781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.837473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.837751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.838029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.838774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:16.839083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.840482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.848058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 233/445] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:16.848830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.901143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5d53-60a2-4d6a-8d4b-f1ed1b05d429 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.932111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.932940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.933222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.933521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:16.934673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:16.936117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:16.937732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 213/446] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:16.938474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:16.941466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1142b6-17ab-4f47-a733-6cf0b408beee None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:16.972939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:16.973611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:16.973899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:16.974175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.034554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124855f-f510-4b13-bd1c-653884ea58ca None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.037175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.038670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.066796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.067350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.067629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.067899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.130029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.131469 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.132696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 234/447] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:17.133543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.222932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 214/448] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:17.223745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.224000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811d76-7662-4767-8e8f-07a04ec35894 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.256029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.256656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.256931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.257197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.258036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=06fc65a8101d4011b29fe6eff82786ba) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:17.258341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.259761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.265208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 235/449] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=06fc65a8101d4011b29fe6eff82786ba&role.id=ace62a47cba3428196ca1286882b1fae => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:17.266000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.326454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408a4b-fe32-4766-b32a-ac8f0652e965 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.365694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.366585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.366868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.367145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] PATH_INFO: `/v3/projects/3869decee235490cb9b23376a9ec23ec` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.368458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] RBAC: Authorizing `identity:get_project(project_id=3869decee235490cb9b23376a9ec23ec)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.370018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.371928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 215/450] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/projects/3869decee235490cb9b23376a9ec23ec => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:17.377762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.380023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc201-e3e1-4129-901e-06cb2845f0fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.415861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.416732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.417007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.417376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] PATH_INFO: `/v3/projects/b2c901f308ac4cb5a886d5753a418090` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.418684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c901f308ac4cb5a886d5753a418090)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.420138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.421876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 236/451] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/projects/b2c901f308ac4cb5a886d5753a418090 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:17.428100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.491177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190aec2-e11d-4902-b707-de6bd28fa233 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.526581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.527457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.527725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.528005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] PATH_INFO: `/v3/groups/dc5c27e41bf24ce9b745dac480ec5355` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.529211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] RBAC: Authorizing `identity:get_group(group_id=dc5c27e41bf24ce9b745dac480ec5355)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.530689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.537480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 216/452] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/groups/dc5c27e41bf24ce9b745dac480ec5355 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:17.538953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.540453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070601c8-53b7-4a56-a13b-1a6851d4ce24 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.577094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.577940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.578474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.578745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] PATH_INFO: `/v3/groups/1c9b92c3b1c3423f985815b615a9376a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.580387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] RBAC: Authorizing `identity:get_group(group_id=1c9b92c3b1c3423f985815b615a9376a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.581976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.584241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 237/453] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/groups/1c9b92c3b1c3423f985815b615a9376a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:17.589684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:17.648545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d99b-95f6-49e6-80a1-839b86a638a5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.685276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.685983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.686268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.686545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.687373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] RBAC: Adding query filter params (group.id=dc5c27e41bf24ce9b745dac480ec5355, role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=3869decee235490cb9b23376a9ec23ec) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:17.687683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.689767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910a5e-8cab-466a-bc09-f9d6573895fb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.692696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e390db-9bdc-4c44-a932-0884a7d29d82 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:17.697743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 217/454] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/role_assignments?group.id=dc5c27e41bf24ce9b745dac480ec5355&scope.project.id=3869decee235490cb9b23376a9ec23ec&role.id=0b140cf23eea4013a92d34840813e9cf => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:17.729753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:17.730431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:17.730714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:17.730991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:17.731845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] RBAC: Adding query filter params (group.id=1c9b92c3b1c3423f985815b615a9376a, role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=b2c901f308ac4cb5a886d5753a418090) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:17.732158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:17.733676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a7dd-adb6-43c2-9e23-ed5733ba44be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:17.741402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 238/455] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Aug 23 05:45:17 2022] GET /identity/v3/role_assignments?group.id=1c9b92c3b1c3423f985815b615a9376a&scope.project.id=b2c901f308ac4cb5a886d5753a418090&role.id=ace62a47cba3428196ca1286882b1fae => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:20.791450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb10-e003-448f-aa7d-10c4dfe6d452 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:20.792463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb10-e003-448f-aa7d-10c4dfe6d452 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:20.792967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1cb10-e003-448f-aa7d-10c4dfe6d452 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:20.795363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 218/456] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:20.800447 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:20.800892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:20.800996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:20.823042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:20.824484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:20.855362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8894e1-f5c4-46d2-a5bc-0b0126baf1ae None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:20.855921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8894e1-f5c4-46d2-a5bc-0b0126baf1ae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:20.856373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8894e1-f5c4-46d2-a5bc-0b0126baf1ae None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:20.858602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 219/457] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:20.863699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:20.864216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:20.864684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:20.881936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:20.883460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:20.915841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 239/458] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:20.959434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 220/459] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:20.965455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:20.984404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.069681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178bb5-f395-4bb0-8110-803ceb3785af None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.083247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992f5fa-1d5c-4fce-82d5-31b062166f0d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.103740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.104525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.104802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.105073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.115729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.117239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.120340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.121215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.121572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.121910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.133570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.135091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.135718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-f89610ec-07c5-4a5e-958d-374c623fa971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:21.137541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 240/460] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:21.138803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328672-78c4-454f-a737-5bc06d45a045 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.139223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328672-78c4-454f-a737-5bc06d45a045 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.139628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328672-78c4-454f-a737-5bc06d45a045 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.142279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 241/461] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:21.147296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.147774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.148210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.154387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:21.155844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 221/462] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:21.156812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.170169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:21.171994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:21.256799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 242/463] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:21.258371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.290321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48125-4eeb-4156-bc18-1be42b8a496c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.334407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.335555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.335979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.336485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.338272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:21.338741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.340317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.355933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 222/464] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:21.356960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.369703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb33e0-56a3-4a19-94de-61d16c267d21 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.405543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.406482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.406959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.407466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.408404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:21.408901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.410551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.422567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 243/465] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:21.424168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.476476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652633df-f71c-4513-828d-50218c5c7800 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.521872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.523006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.523295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.523606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.524908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadd81c-fcc4-4aad-906e-a3265e2dfaa0 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.536346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.537987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.557970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:21.559437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.560356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.560904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.561372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.562290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.564567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.564986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 223/466] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:21.565847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.646325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 244/467] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:21 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:21.647603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.668029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1a2a-eda1-412e-bfd0-564c10046e3f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.708484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.709178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.709478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.709760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.710492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.712039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95265-6b52-40bc-9274-236731c5e9d1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.766198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a29cac-d1ff-43e6-8a33-c044e9ee2187 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.793900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 224/468] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:21 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:21.796203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861202f-d68a-4e57-b25c-a34d38f405df None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.796694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861202f-d68a-4e57-b25c-a34d38f405df None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.797235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861202f-d68a-4e57-b25c-a34d38f405df None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.803576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 225/469] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:21.807956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.808696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.808953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.809229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.810233 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:21.810628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.810888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.811361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.811888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.812055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:21.829407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 245/470] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:21.833685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.846370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:21.848007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:21.931007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 226/471] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:21.947087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4ba8-ddd4-4cc7-b823-5e57caef9d7b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:21.957110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:21.984436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:21.985116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:21.986044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:21.986327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:21.987040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:21.988513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6cd7-3da2-41a9-80a6-0cb56c4532ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.064656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c9484-e5fc-4c88-a55b-72cd170d3dab None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.098483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 246/472] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:21 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:45:22.105697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf133cf-ef78-4212-b4c5-c2db909472e3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.106292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf133cf-ef78-4212-b4c5-c2db909472e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.106744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.107011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf133cf-ef78-4212-b4c5-c2db909472e3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.107659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.107951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.108324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.110961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 247/473] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:22.116520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.117755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.118264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.123264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:22.124870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.147851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:22.149314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 227/474] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:22.150516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:22.151742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:22.155032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:22.254042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 248/475] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:22.285257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75c90-0f6d-42b9-8c1b-f3005a2dfd82 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.289520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:22.350309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.351342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.351830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.352313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.353221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:22.353811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:22.355428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.367924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 228/476] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:22.377608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:22.417391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8063-c812-4764-add6-cd8001e1e72d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.453014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.454649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.454935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.455210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.455970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:22.457763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.481644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ee4d2-62bc-42e8-8a32-98858691548e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.504572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.sql.core [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 05:45:22.504572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 05:45:22.504572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [parameters: {'id': 'a8dc7724ceaf4db6b78b786a6378dd24', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 05:45:22.504572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 05:45:22.517786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.518738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.519265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.519749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.520639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:22.522307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.524704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 05:45:22.526485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 249/477] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Aug 23 05:45:22 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:22.532927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:22.601749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 229/478] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:22 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:22.651082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87489b-1e51-465d-b93e-ae5656f94762 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.686348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.687168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.687451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.687727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.700146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:22.708599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-25c93b00-2de1-48a7-b72c-31727c8af3cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 05:45:22.709887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 250/479] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:22.715887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:22.822328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000194c-79d1-4e79-86bb-8c3f59cef4fd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:22.858588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:22.859277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:22.859548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:22.859826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:22.860634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:22.860939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:22.862400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb03eec-c46b-4d5f-b08c-4a18a6838d96 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:22.874572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 230/480] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:24.595169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c38-9a97-43ba-8b94-d6cfbde825a8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:24.595794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c38-9a97-43ba-8b94-d6cfbde825a8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:24.595794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c38-9a97-43ba-8b94-d6cfbde825a8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:24.597767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 251/481] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:24.602859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11f7d-7423-4340-b596-299a5bfac8e2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:24.603283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11f7d-7423-4340-b596-299a5bfac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:24.603455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11f7d-7423-4340-b596-299a5bfac8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:24.622306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-08b11f7d-7423-4340-b596-299a5bfac8e2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:24.623479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-08b11f7d-7423-4340-b596-299a5bfac8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:24.707540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 231/482] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:24.748195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928c38-9a97-43ba-8b94-d6cfbde825a8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:24.870105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5ef2-91a1-4fbc-aa6d-c7407321c4d5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:24.870454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5ef2-91a1-4fbc-aa6d-c7407321c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:24.870662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5ef2-91a1-4fbc-aa6d-c7407321c4d5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:24.872672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 232/483] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:24.878091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:24.878243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928c38-9a97-43ba-8b94-d6cfbde825a8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:24.878441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:24.878645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:24.915596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:24.916782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:24.918668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:24.919464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:24.919744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:24.920021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:24.939425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:24.950109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:24.953517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 252/484] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:24.966743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.014874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 233/485] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:25.062997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.135858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62f10-c3e4-45f9-ba2c-1792f67007d2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.173633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.174315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.174596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.174870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.175638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:25.175925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.181555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.197207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 253/486] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:25.197207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.231055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b258a16-8a8c-4557-a6dc-f361337b2bb2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.278816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.279627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.279906 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.280178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.293924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1551ff-0446-4cd8-9c15-9704139575e5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.307976 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:25.319579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:25.320961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 234/487] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:25.343214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.357800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.358607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.358888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.359230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.380550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.380993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.410165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:25.411792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 254/488] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:25.426957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.460002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df72c0-5aa5-45cd-8cc1-8daa64510501 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.496461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.497496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.497956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.498440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.499405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:25.499924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.501605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.510863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 235/489] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:25.520943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.591943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60ac95-2317-4f75-b187-b7810b774f4e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.624321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.624967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.625247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.626062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.626843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:25.627144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.628527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734f610-d794-4701-b990-161b2aa99811 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.637708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3642ae-21cb-4ebd-86d7-44b439572310 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.640292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 255/490] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:25.642314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e29b-8a6d-470a-a398-39bd09b4bda3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.642802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e29b-8a6d-470a-a398-39bd09b4bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.643256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e29b-8a6d-470a-a398-39bd09b4bda3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.645350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 256/491] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:25.646733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e064-21fb-4634-b1ff-9b12e5ccbcbf None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.647222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e064-21fb-4634-b1ff-9b12e5ccbcbf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.647700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e064-21fb-4634-b1ff-9b12e5ccbcbf None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.649493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 257/492] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:25.650703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e064-21fb-4634-b1ff-9b12e5ccbcbf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.673948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.674734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.675019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.675293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.685506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.689676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.704184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-25b4de92-13bf-41a0-a07a-4f8152c45797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:25.705354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 236/493] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:25.706616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8faf-5269-4df9-bb6f-14c47c56a73f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.706907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8faf-5269-4df9-bb6f-14c47c56a73f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.707184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8faf-5269-4df9-bb6f-14c47c56a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.724434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0a6e8faf-5269-4df9-bb6f-14c47c56a73f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:25.725637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0a6e8faf-5269-4df9-bb6f-14c47c56a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:25.772754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e064-21fb-4634-b1ff-9b12e5ccbcbf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.801455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 237/494] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:25.801455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.801455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.801455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.816620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.817783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.818269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.818727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.820453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:25.821665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:25.826732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.829312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.844326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:25.846654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 258/495] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:25.847427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.890466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 238/496] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:25.891960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:25.944329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e101-edc7-4681-b92e-550cc4ecdc41 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.975764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:25.976494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:25.976834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:25.977183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:25.977996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:25.978301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:25.979676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:25.982467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ebf6d-eb41-4efb-98ba-553e6fc5497c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:25.991464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 259/497] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:25.992102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.017595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.018381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.018664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.018932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.028555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:26.035437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-5e76fb01-f2de-4de3-8504-568519fff529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:26.036644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 239/498] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.037898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22040c5-b1b1-4e9e-baf4-232d94d29213 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.038188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22040c5-b1b1-4e9e-baf4-232d94d29213 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.038464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22040c5-b1b1-4e9e-baf4-232d94d29213 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.041564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 240/499] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:26.041564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22040c5-b1b1-4e9e-baf4-232d94d29213 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.089827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b86ac6-533a-475d-afd0-b1177719dd29 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.125061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.126381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.126665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.126942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.127776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:26.128082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.129555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.137027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22040c5-b1b1-4e9e-baf4-232d94d29213 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.164525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 260/500] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:26.165167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.168898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.169713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.169999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.170273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.180599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:26.187557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:26.189264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 241/501] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.190042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.258651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc50c3-6b59-4df8-bb6a-18dc265528fe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.282144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fce79-8ca0-4a4e-8981-595c9db8f50e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.289369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.290171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.290449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.290720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.297896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.299351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.312416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-90d163d3-e980-4ac9-abc9-bfaf825023cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 05:45:26.314202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 261/502] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.318899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.318899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.318899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.319152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.319244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.319326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.319326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.319482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:26.319482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.319482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.325973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 242/503] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:26.326603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.334395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:26.335559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:26.400055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 262/504] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:26.400880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.421506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a349f-4e4a-4d83-96fd-80493962b593 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.454052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.454689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.454971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.455246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.510829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2b68-80d1-4d1f-beb4-60b8f6326325 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.517768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.519207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.542404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.542986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.543266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.543540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.544276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:26.544575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.545981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.553920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 263/505] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:26.554684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.612517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 243/506] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:26.613653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.646085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e6054-2641-4976-bec1-7c0f3aa690e7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.677983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.678633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.678909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.679178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.680000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:26.680301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.681756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.699105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 264/507] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:26.699894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.707078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc06b7-2d4f-46dc-a70d-1833e8cef53a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.739259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.740036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.740326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.740600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.750175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.751652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.768268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:26.769453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 244/508] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.770219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.792914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408cc02-6f9b-4f69-8435-56143e8db276 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.824442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.825242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.825549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.825827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.836154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.837627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.854406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:26.855569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 265/509] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.856358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.863109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e67ef-f048-4f4e-82dd-345d0da35c01 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.894690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.895459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.895736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.896009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.905374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.907482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:26.923334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:26.924478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 245/510] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:26.925234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:26.952417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999c19c-cd25-4e84-8643-d5362f0c3df2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:26.984859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:26.985739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:26.986020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:26.986289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:26.995824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:26.997252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.013183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:27.014500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 266/511] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:27.015266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.018213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cc89-8a19-4e75-b8e5-2134816c7d50 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.050500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.051065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.051345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.051618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.111236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf0af6-c5b3-4305-8673-1c79037ec11f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.113962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.115429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.143851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.144487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.144767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.145043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.145790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:27.146099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.147470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.158056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 267/512] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:27.158869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.208167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 246/513] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:27.209083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.254561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43962e3-32ac-4f43-be77-56586aed4291 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.286189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.286853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.287139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.287420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.288138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:27.288447 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.289867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.299825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eabc15-6f2e-4923-99f7-33c48e72f104 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.300998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 268/514] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:27.301772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.332832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.333502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.333781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.334050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.334751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:27.335057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.336411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.349850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 247/515] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:27.349850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.401294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea41b3-2fa7-48f1-9b49-a1075fcd31d7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.432839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.433521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.433807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.434083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.434796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:27.435101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.436483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.442585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a4574-23ab-4e0a-8250-adf9f6295887 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.447537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 269/516] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:27.448394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.475484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.476271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.476548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.476818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.485316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.486791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.499547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 05:45:27.501287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 248/517] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:27.502042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.542395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200a8d5-cdce-4f31-8142-a263b6e6c41d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.574189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.574934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.575215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.575489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.585615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.587066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.595718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b30a-68cf-47cd-85b1-4c23275f3df1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.602574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:27.603715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 270/518] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:27.604477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.628107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.628761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.629057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.629340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.630058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.631485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.701088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679c21f-465c-40b3-9caf-36bc4b7462fe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.732243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.733025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.733311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.733623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.741180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.742678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.748023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 249/519] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:27 2022] POST /identity/v3/users => generated 247 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:27.748831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.756532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 05:45:27.763143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 271/520] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:27.763143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.858501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333544-a194-4ed9-accf-f0e377e7c84f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.866546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6cd76-c37f-4c9c-9c45-360bb0e1a815 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:27.894032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.894837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.895123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.895415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.900158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:27.900833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:27.901112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:27.901383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:27.902258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:27.902563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.902736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:27.904039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.904217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:27.918957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:27.925270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 250/521] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:27.925270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:27.928922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 272/522] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:27.929139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.021840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ad09-0fbb-4bd8-b98d-e2b6d6ba3075 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.032562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a732da-be92-4176-ba11-bbe78e37d519 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.055429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.056089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.056375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.056658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.057375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.057727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.059106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.066736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.067563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.067981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.068386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.069366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.069877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.070556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 251/523] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.071193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.072131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.089538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 273/524] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Aug 23 05:45:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.094945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.177754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9725-ce16-4af8-84e8-977b7b7eeb91 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.196229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132d3a-a78f-4427-9442-51c606c2ab91 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.211159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.211896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.212186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.212464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.213250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.213842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.215107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.230082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.231039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.231039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.231284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.235489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 252/525] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.236518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.297140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.298637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.337009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0405db-5962-45c5-a1ce-59ebfc6881cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.371195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.371983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.372268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.372546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.379246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.380700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.394494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:28.400678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 253/526] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:28.400678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.408477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 274/527] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:28.409264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.502864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9462a6-dd39-4213-86be-de004e6725e3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.532462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fef390-2e14-4d26-bee4-f5290a55b714 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.538920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.539570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.539849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.540124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.541033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.541259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.542737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.548116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 275/528] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.548901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.569843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.570753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.571198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.571613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.645408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.647160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.661057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ffe4f-2746-4549-a317-aeab094a0665 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.698963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.699526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.699808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.700083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.700905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.701247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.703045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.727945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 276/529] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.727945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.761668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 254/530] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:28.761668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.836462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caa655-509b-421a-b9ba-9f733cbd03ed None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.856944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5b20-3305-45f8-92d4-c175e70d91e6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:28.871696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.872793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.873298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.873788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.884297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.886150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.891466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:28.892118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:28.892397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:28.892672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:28.893544 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=f0d9910443224e84af4396d4b9af0656) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:28.893845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:28.895274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:28.908454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 255/531] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/role_assignments?user.id=f0d9910443224e84af4396d4b9af0656&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:28.908454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:28.913574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:28.915052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 277/532] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:28.921616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.023924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b60c2-1afb-47ae-acda-86a920300e49 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.098493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.099297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.099579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.099856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.111411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59662013-cc50-43de-869f-1bf3ed1bdcc2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.122319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.123806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.150882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:29.152158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 256/533] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:29.162708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.178314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.179307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.179810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.180314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.181236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.181774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.183482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.197173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 278/534] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:29.203597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.276455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630469-75cb-4b8a-b4be-e86de700497a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.306634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaf32-11b1-4455-91e2-03d4c7d7e281 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.311150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.311816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.312098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.312938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.313693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.313999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.315393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.327614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 257/535] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:29.333560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.345808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.347004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.347508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.347997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.371924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.373880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.398112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:29.405177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 279/536] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:29.410658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.440541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50b5e-e061-49c9-81d2-ef595d7201f4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.478533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.479327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.479607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.479881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.487823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.489716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.504959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:29.506872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 258/537] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:29.512557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.619684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc718092-95b2-47da-99fc-d5cf2bd2faa8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.637534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de017d-90c6-4947-88d3-ad250e7a6eeb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.654472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.655128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.655409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.655683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.656501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.656806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.658267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.670115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 259/538] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:29.676308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.698156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.698828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.699108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.699383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.700167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.700474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.702223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.719040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 280/539] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:29.724000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:29.776130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c8546-6120-4b6c-b03f-d92f08036267 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.811844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.812534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.812815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.813092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.813971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=064fd80565d543dfaca680bebfbb7127) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.814282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.815717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8d88e-a131-4213-8348-86be528a1524 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.821590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 260/540] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/role_assignments?user.id=064fd80565d543dfaca680bebfbb7127&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:29.832157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24276b-d6d8-450f-a28e-a074c2eee017 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:29.884258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:29.884852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:29.885139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:29.885412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:29.886297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0b52b24c45b04205922a4394f8eddea1) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:29.886667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:29.888901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014afb4-b2ab-49a6-8776-075d323d88d3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:29.897535 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 281/541] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:29 2022] GET /identity/v3/role_assignments?user.id=0b52b24c45b04205922a4394f8eddea1&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:30.447368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4f9f-7d56-4863-9db1-0c799acabd8f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:30.448046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4f9f-7d56-4863-9db1-0c799acabd8f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:30.448533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4f9f-7d56-4863-9db1-0c799acabd8f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:30.450622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 261/542] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:30.456311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:30.456861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:30.457341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:30.486182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:30.487737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:30.583759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 282/543] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:30.627330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d4f9f-7d56-4863-9db1-0c799acabd8f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:30.751355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d4f9f-7d56-4863-9db1-0c799acabd8f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:30.797811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:30.798615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:30.798883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:30.799157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:30.812866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:30.819995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:30.821551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 262/544] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:30.830492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:30.957898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1057b4-55c4-4554-ae7f-37df819d16bd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:30.996839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:30.997823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:30.998263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:30.998672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.000067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:31.000509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:31.002088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:31.014840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 283/545] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:31.016773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.173532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f3e6-2f80-4d55-b60e-d456813a31bb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.217132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:31.218192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.218672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.219079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.239579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:31.241072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:31.263562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-705b6bd1-1af4-423f-9967-e982022bcf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:31.265000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 263/546] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:31.270235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.290241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca34d-7495-4945-8a64-ad8a0f1a511e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.290553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca34d-7495-4945-8a64-ad8a0f1a511e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.290801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca34d-7495-4945-8a64-ad8a0f1a511e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.292811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 264/547] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:31.298360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.298644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.298967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.327010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:31.328447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:31.426434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0c916-8718-48ca-b0e5-0984fd0fc8cc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.450546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 265/548] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:31.476646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.489368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:31.490065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.490352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.490632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.491357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:31.491694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:31.493078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:31.515994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 284/549] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:31.521205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.588652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85162-2ff8-4209-82d1-fd647a109566 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.643919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:31.644721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.645004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.645277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.664530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:31.672178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:31.673382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 266/550] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:31.686402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.707111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4f81-5115-4714-99b1-be3ff7571319 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.745208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:31.746932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.747589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.749002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.760413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:31.766265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:31.792315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:45:31.797774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 285/551] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:31.801536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:31.918234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756975c-24d1-4127-b8a2-8ce2d792d7e5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.919654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eea83-3bab-4294-942e-9daef7982bcc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:31.960594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:31.961622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.965130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.965637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:31.966663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:31.967153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:31.969405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45360a36-9431-4f55-817a-b213dca6effe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:31.992337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 286/552] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:31.997663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259670ed-3c9f-4b72-98f8-750bbd741a3c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:31.998118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259670ed-3c9f-4b72-98f8-750bbd741a3c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:31.998672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259670ed-3c9f-4b72-98f8-750bbd741a3c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.001004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 287/553] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:32.002062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259670ed-3c9f-4b72-98f8-750bbd741a3c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.003174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.003930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.004277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.004617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.005426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:32.005818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.007371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813cac9-5e4a-4382-96e0-fe35b405938e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.019918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 267/554] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:32.021513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.021937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.022388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.039789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:32.041212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:32.108686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 268/555] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:32.109811 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259670ed-3c9f-4b72-98f8-750bbd741a3c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.110998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.148582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.149553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.150006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.150479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.222197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.223983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.233647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bca8d2-abd1-445c-bb1b-a18b30ed1aaa None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.268716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.269894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.270437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.270918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.281799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.283480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.300425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:32.301961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 269/556] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:32.303060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.325167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 288/557] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:32.326392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.408659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc39b-f4fc-419f-832d-bb4a4b30aa0c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.441072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ef6ca-2ddf-4793-8713-2e239f977762 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.442835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.443924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.444428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.444898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.457929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:32.465482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:32.472080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 270/558] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:32.473393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.480211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.480885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.481167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.481462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.482210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:32.482517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.483952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.495371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 289/559] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:32.496239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.580618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017484-2416-4dc1-aada-72e5d74dadae None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.597084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ccbd6-48a0-4a05-a9b8-72c3700185a9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.614867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.615653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.616324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.616609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.629573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.629834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.630496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.630784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.631032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.631136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.631864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:32.632176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.633562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336827-acdf-4bad-946c-f6012e3ee398 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.642495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 290/560] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:32.643996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6483-9bb8-4482-9701-b4efae67a21a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.644481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6483-9bb8-4482-9701-b4efae67a21a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.644968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6483-9bb8-4482-9701-b4efae67a21a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.648455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:32.650608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 271/561] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:32.650608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.651182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 291/562] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:32.654892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c6483-9bb8-4482-9701-b4efae67a21a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.746300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c1bb-8979-42df-89ce-cfb287390439 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.757715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c6483-9bb8-4482-9701-b4efae67a21a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.779433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.780219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.780500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.780805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.788340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.789915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.790500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.791285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.791567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.791843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.803312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.804068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ee332772-8b80-46d5-a272-0451cfe1be9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:32.804756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.810064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 272/563] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:32.810064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.810064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.810064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.826435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:32.826881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:32.827920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 292/564] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:32.828014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:32.828695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.890762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 273/565] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:32.891501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:32.936048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5193-d74b-4727-915a-092f9e3e144d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.967437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:32.968173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.968460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.968732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.969466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:32.969773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:32.971133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b47fc-1461-4d88-8e59-7a3bccad5dd4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:32.982136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 293/566] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:32.982366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21ab75-0286-465b-9617-1e85d73a5703 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:32.983360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b4ac-0b49-44ff-a265-cd4e1ac4df6e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:32.983648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b4ac-0b49-44ff-a265-cd4e1ac4df6e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:32.984425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b4ac-0b49-44ff-a265-cd4e1ac4df6e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:32.986117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 294/567] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:32.986805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b4ac-0b49-44ff-a265-cd4e1ac4df6e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.019055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.019718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.019992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.020261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.021074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.021376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.022832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.058517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 274/568] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.059313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.084432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b4ac-0b49-44ff-a265-cd4e1ac4df6e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.116632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.117277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.117592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.117869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.118579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.118879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.120228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.130774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 295/569] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.131543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.152475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24582f-0407-4f35-99d6-9b4889a8e49a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.184607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.185381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.185685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.185955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.195445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:33.202665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b1c2f5d5-5000-4a17-a7b3-a3b22cc4a7c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:33.203819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 275/570] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.205013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.205297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.205664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.221874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:33.223037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:33.224246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15184-121f-429a-a3a0-9dd75a51dbe5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.255538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.256306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.256583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.256854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.263162 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.264594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.278000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:33.279398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 296/571] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.279914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.290402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 276/572] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:33.291479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.375384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-5fd2-4d8c-b9e7-0059652f4507 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.386200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d95fa2-372f-4583-a0dd-3027d7d757ec None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.410266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.410959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.411265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.411544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.418420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.419192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.419473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.419742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.421916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.423399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.427385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.428801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.439635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:33.440800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 297/573] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.441593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.442069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 05:45:33.443207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 277/574] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.443949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.537495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624718-bb39-4d68-a825-f39614fdf9a8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.539154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92976-5110-4831-b46e-5dd883c1621f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.568901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.569675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.569960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.570239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.570446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.570981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.571082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.571290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.571381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.571603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.572369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.572669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.572765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.574117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.581071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 298/575] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.581875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.588053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 278/576] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.588053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.672912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f88a4-f28f-476d-8c27-93bc986263da None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.681319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c09b-11ec-4a7f-871b-642649f77a93 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.703943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.704722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.705001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.705271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.713229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.713902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.714184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.714458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.714799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:33.715160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.715461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.716822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.722255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:33.723609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 299/577] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.724154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.732996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 279/578] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.732996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.816047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b34a8-c81f-4f65-beeb-87b89c3ed10c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.820805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475202a-8c91-48b9-bc62-47cbdba0aad9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.847550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.848189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.848466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.848797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.849646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.849950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.851367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.852899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.853707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.853980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.854251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.863841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.865248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:33.867704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 300/579] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:33.868498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.882131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:33.883298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 280/580] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:33.884052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:33.963139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7f40-71db-4b9c-ab64-1427a49cd320 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.975124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc105f-b7df-4169-971b-105d88f4284c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:33.994191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:33.994824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:33.995100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:33.995369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:33.996180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=ffe3c9bd5d944466b9b8d1fd3f904026) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:33.996482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:33.997941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.003885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 301/581] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/role_assignments?user.id=ffe3c9bd5d944466b9b8d1fd3f904026&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.004437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.009719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.010481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.010834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.011108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.011865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.012167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.013606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.023405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 281/582] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.024048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.109542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87995-123d-4649-99b9-7f92ad75e5e7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.127407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810663-c631-4986-91d4-1c31181fb653 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.144511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.145616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.145896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.146171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.153223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.154736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.162157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.162948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.163227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.163498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.168688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:34.175221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 302/583] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:34.175221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.179906 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.181383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.201775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:34.207601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 282/584] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:34.207601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.276623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffdd4d-2515-4995-89f7-039e4dd68cb9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.299648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672393-3721-4093-acdc-84fbb392c80c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.309587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.310251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.310528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.310799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.311513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.312371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.313767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.325304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 303/585] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.330445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.336910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.337741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.338027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.348565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.352201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.354057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.371120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:34.377402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 283/586] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:34.377402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.435886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c542d5-153a-412d-b24a-dbd200415538 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.469189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.469486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496823-ba41-49b7-947a-4857b3ea447a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.469965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.470248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.470522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.471305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.471622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.473055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.484765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 304/587] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.490280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.504163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.504825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.505110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.505388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.506135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.506466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.507831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.523408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 284/588] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.523408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.586289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3028f2-9b98-43bd-a041-3a0d76379689 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.618664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.619450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.619731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.620003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.620099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418f6d-6c0d-47e6-8789-8d97b9e1fa29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.627346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.628796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.641990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 05:45:34.643444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 305/589] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:34.644202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.657607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.658263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.658541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.658812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.659521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.659821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.661184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.676851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 285/590] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:34.676851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.742025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0003a-07e6-4abd-92c0-f4b8aeffdc18 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.773986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86d8c-e0c5-44a0-b757-4494f84a0d87 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.776219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.777108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.777391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.777698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.792373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=18cdab9833c3477b9c95fb011e629bb0, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.794031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.808158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.809012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.809294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.809646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.816752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.818210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:34.832093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:34.833267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 286/591] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:34.834050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.897056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 306/592] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:34 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:34.898024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:34.935485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c3ce-ab63-48de-a8b4-66ccd6721de2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:34.973167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:34.974174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:34.974587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:34.975035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:34.976055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:34.976516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:34.978168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.003387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 287/593] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:35.004615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.011575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9ad1-5169-44f3-88bf-686fb1e9e270 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.048712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.049721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.050106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.050487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.058623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.060294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.077523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 05:45:35.083255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 307/594] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:35.083255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.118671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68c65-b558-4c82-ba61-281cb4fd0a5f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.156218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.157096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.157568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.157981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.158900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:35.159346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.160934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.173773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 288/595] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:35.174860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.192412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4affd3-f8e1-4c9e-b4db-5cfed1bbf60f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.226753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.227699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.228087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.228467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.239561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.241155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.258787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:35.264526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 308/596] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:35.264526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.282945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590f53-0fe4-4ffb-ae64-0d4db467c625 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.317678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.318570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.319019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.319488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.320497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:35.320942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.322571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.345429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 289/597] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:35.346501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.362482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7d9d-6be8-4bdf-85a9-d800dcdfa982 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.397680 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.398700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.399085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.399481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/f0d9910443224e84af4396d4b9af0656/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.416037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=f0d9910443224e84af4396d4b9af0656, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.417681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.451123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4c2b2-3021-4212-8ca9-8c1fa2ea3a45 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.485667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.486512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.486934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.487347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.488219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:35.488664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.490178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.506217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 309/599] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:35 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/f0d9910443224e84af4396d4b9af0656/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:35.506474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 290/599] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:35.513806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.513947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.616113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978becd-5acd-4582-be71-be2b456702a2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.650831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.651690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.651970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.652246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.660091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.662393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.679409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:35.680856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 291/600] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:35.687696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.706109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd58-29b0-49ae-88f2-164f091ad3be None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.790193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.791487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.792102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.792570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.805572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fbebe-e5ad-48ec-8d35-7b6241ab8638 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.817373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.819193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.837202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:35.839029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 310/601] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:35.847265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.848248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.848732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.849750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.849853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.850865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:35.851412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.854273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:35.872459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 292/602] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:35.880213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:35.956756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0ba4-8285-4023-9021-3b9ae0ab70fd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.985718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d292c-e0de-47a1-b665-d43603d20dc3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:35.991298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:35.992007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:35.992302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:35.992559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:35.993301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:35.993636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:35.995070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.021824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 311/603] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:36.030046 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:36.031402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.032518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.033013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.033512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/064fd80565d543dfaca680bebfbb7127/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.049609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=064fd80565d543dfaca680bebfbb7127, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:36.051409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.145828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c9aa-0928-4c1e-a18d-1836f53f32c6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:36.157554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 293/604] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:35 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/064fd80565d543dfaca680bebfbb7127/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 05:45:36.207019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.208124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.208603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.209086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.216660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:36.218884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.240526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-b62ca2d4-9057-4582-828b-22bec1649534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:36.246614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 312/605] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:36.252547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:36.366588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43354-5113-4566-82f1-350bf5ac42dd None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.367159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43354-5113-4566-82f1-350bf5ac42dd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.367609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43354-5113-4566-82f1-350bf5ac42dd None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.369780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 313/606] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:36.376423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.376423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.376423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.410254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7de38-b324-4262-9825-51d20a9602d8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:36.413096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:36.415392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:36.495094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.495753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.496032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.496304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.497092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:36.497394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:36.498907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.509212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 314/607] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:36.517405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 294/608] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:36.523793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:36.537220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:36.632748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19107a-ba8c-4656-b996-1143a84a2706 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:36.680484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.681086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.681456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.681801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0b52b24c45b04205922a4394f8eddea1/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.702673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44092173-d3a4-402e-a9ba-6f8e211ca3df None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:36.714425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=0b52b24c45b04205922a4394f8eddea1, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:36.715780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.737783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.738917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.739438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.739908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.751404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:36.758782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:36.760198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 295/609] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:36.766687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:36.782218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 315/610] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:36 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0b52b24c45b04205922a4394f8eddea1/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:36.923073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b293a86-78d4-48c3-b33b-c77a078ca12d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:36.969478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:36.970549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:36.971027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:36.971499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:36.972467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:36.972973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:36.974584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:36.984190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 296/611] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:36.989571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.126160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fcd87-8f52-4616-a3d0-489d142caaaf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.162507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.163294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.163624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.163901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.174485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:37.175941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:37.192554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:37.194075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 316/612] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:37.199584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.320291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be764c7-cebb-4fdd-aee0-6ef9dfc437b2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.362820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.363918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.364444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.364915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.365877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:37.366377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:37.367946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ac03-31a8-48e4-9fce-a374c444f736 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:37.384937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 297/613] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:37.390365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.442752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d97c-ea53-4417-a728-c83ac8c37a02 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.443073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d97c-ea53-4417-a728-c83ac8c37a02 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.443342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d97c-ea53-4417-a728-c83ac8c37a02 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.446120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 298/614] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:37.450013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.450295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.450571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.486433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:37.487806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:37.512347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d589b-e7a0-4d93-92c6-d7904d5870fd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.549462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.551080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.552018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.553397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.569216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:37.571019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:37.590321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:45:37.600084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 317/615] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:37.606304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.626001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 299/616] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:37.657261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.770189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59dd43-5c09-4f9e-abb0-2f9dab267cc2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.807300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.808311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.808811 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.809277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.810750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:37.812831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:37.815789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:37.834134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557e7c-d535-4142-bb9b-007a7a302ca4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.850560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 318/617] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:37.856186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.903087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.903889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.904166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.904437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:37.934421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:37.950125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:37.951955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 300/618] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:37.957571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:37.961873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147abee4-f2c1-46de-a21d-d1fe4b48722e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:37.997136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:37.998328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:37.999384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:37.999875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.011652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.013476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.031185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:38.033036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 319/619] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:38.039404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.113479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc07f-839f-4d30-abb9-5f3e59a3ae7a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.147115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.148149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.148622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.149106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.150067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:38.150560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.152109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.161336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 301/620] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:38.166865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.227557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ee05-8f1d-4ff4-81dc-36db5dae4cf5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.276320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ecf-da6d-4d4f-a44e-754672d9447d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.313451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.314755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.315392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.315856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.320555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.324959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.325517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.326304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.327881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:38.329059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.330666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.337234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.340252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.362833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 320/621] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:38.367807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.388360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-f5f3262f-3c30-4748-8a2b-4be9480c34c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:38.390678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 302/622] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:38.392260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fdc5-5720-4c84-8f67-4100bf1014f2 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.392759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fdc5-5720-4c84-8f67-4100bf1014f2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.393232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fdc5-5720-4c84-8f67-4100bf1014f2 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.395919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 303/623] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:38.396868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12fdc5-5720-4c84-8f67-4100bf1014f2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.492023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c480c-9e23-4aa9-be1b-1d48c80204fc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.528282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12fdc5-5720-4c84-8f67-4100bf1014f2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.528797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.529623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.529937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.530208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.537536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.538998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.553991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-0c370f2b-9d27-4f47-a0c0-836fb1d0a400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:38.555465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 321/624] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:38.556644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.556921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.557188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.569861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.571117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.571659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.572121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.573022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:38.573657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.574337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:38.575486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.575591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:38.592496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 304/625] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:38.593871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.653790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 322/626] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:38.654662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.711129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414c24a-6d20-4b70-907c-9ba1cd09b090 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.751102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.751682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.751960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.752233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.753006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:38.753329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.754769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.766537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 305/627] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:38.767346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.791440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e0e79-ec38-42bd-bbf8-d8889b051f07 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.830011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.831088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.831576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.832015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.839357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:38.841074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:38.854957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:38.856672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 323/628] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:38.857653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.873062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7beb9-cbeb-409d-8a15-bb6f1e2df7f8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.907987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.908778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.909054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.909324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:38.921805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:38.929000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:38.934916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 306/629] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:38.935756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:38.959005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b640-bfb9-461e-aec9-948158b59be2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:38.997740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:38.999197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:38.999479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:38.999752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/ffe3c9bd5d944466b9b8d1fd3f904026/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.014472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=ffe3c9bd5d944466b9b8d1fd3f904026, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.015860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.039546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5ac3a-eaad-4042-8e6a-addf7d634462 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.073028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.073709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.073989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.074261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.075113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:39.075416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.077159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43474f9-a1ab-422e-929b-6ab8859453fc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.093106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 324/630] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:38 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/ffe3c9bd5d944466b9b8d1fd3f904026/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:39.093981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.095290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 307/631] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:39.096786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29dac-ee15-445e-9d1a-a4869ffdc211 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.097310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29dac-ee15-445e-9d1a-a4869ffdc211 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.097743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29dac-ee15-445e-9d1a-a4869ffdc211 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.100100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 308/632] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:39.101055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29dac-ee15-445e-9d1a-a4869ffdc211 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.218498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29dac-ee15-445e-9d1a-a4869ffdc211 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.223446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24880-ceb6-4598-bcf0-30757ba91124 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.256777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.257415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.257751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.258030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.261493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.262733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.263177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.263590 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.264606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:39.265055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.266659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4abe-6066-4634-9a2d-903f355ee143 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.275721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 325/633] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:39.277422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.277887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.278308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.297094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:39.298551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:39.346004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.347466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.375651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 326/634] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:39.376788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.468949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 309/635] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:39.469950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.489406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dc471-37c2-4cf8-943f-4db60687b22b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.524784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.525575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.525864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.526230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.536518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.538058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.556702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:39.558262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 327/636] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:39.559042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.589114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d13d6-f89c-4c58-8252-af03c6d6cf21 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.625628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.626467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.626752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.627026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.637126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:39.644365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:39.645983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 310/637] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:39.646894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.677794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b11b5-911f-4ea6-9f45-55d94e34365c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.718516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.719460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.720042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.720321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.732335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.734371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.756534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:39.761523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 328/638] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:39.761701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c23c90-4b17-49e0-9a0a-2b1f6ac58deb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.762451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.794112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.794693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.794974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.795779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.796551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:39.796856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.798255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1100f-9896-48f6-b7ef-8a99d9c4fac6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.809847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 311/639] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:39.816195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69c607-5fff-4de1-9e34-f46eab1e696b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.816484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69c607-5fff-4de1-9e34-f46eab1e696b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.816822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69c607-5fff-4de1-9e34-f46eab1e696b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.821474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 312/640] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:39.821474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69c607-5fff-4de1-9e34-f46eab1e696b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.865078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a167c-87e0-48fc-a13a-cb642ac210e9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.899525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.900186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.900466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.900737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.901500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:39.901804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.903165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.916112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 329/641] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:39.916112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:39.926793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69c607-5fff-4de1-9e34-f46eab1e696b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:39.963612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:39.964274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.964545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.964822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:39.965564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:39.965918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:39.967845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812c53d-a106-41f9-8177-aaffc87006d3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:39.980287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 313/642] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:39.981540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:39.981832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:39.982109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.000002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:40.001180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:40.014513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02fb81-80e4-42d7-88af-ad9986b2a90e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.047305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.048024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.048308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.048600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.055980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.057460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.067205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 314/643] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:40.068219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.070766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 05:45:40.076559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 330/644] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:40.076559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.171518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd10e-9480-48c5-85b3-5f27871d3e70 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.182335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958751-0488-4428-8a1c-ce4f8f70043a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.204399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.205207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.205499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.205782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.215867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.217876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.219140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.221056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.221748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.222335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.230197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.231647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.234668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:40.240598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 315/645] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:40.240598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.248699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:40.249938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 331/646] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:40.250766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.344038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537cb3b-3fcf-4984-9c2c-8df0ef8b47a6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.352177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cabfb-d98c-4bff-9169-805a79d224db None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.382169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.382868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.383292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.383568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.384401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:40.384703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.386203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.390756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.391549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.391833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.392106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.402270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:40.408647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 316/647] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:40.408647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.409862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:40.411155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 332/648] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:40.411794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.506514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864872-fc5a-4a07-88d6-a8eb4660bb6c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.507008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ae69a-7bda-44a4-80f0-b16eb38ef98a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.540122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.541000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.541282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.541589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.542122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.542368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:40.542673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.542767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.543034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.543311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.544016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:40.544192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.544341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.545717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.561685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 333/649] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:40.561830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 317/650] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:40.561830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.562643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.657981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb218-02d0-4d5c-bed5-5ea4960d4574 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.658273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747e97-40dc-4fbf-bda4-b291c8cd9ba7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.691243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.691441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.691905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.692006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.692185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.692288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.692458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.692550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.693192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:40.693526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.694899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.707957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 318/651] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:40.707957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.762674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.764851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.799893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baab82-f3f9-429a-a531-a1264e7acb60 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.835821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:40.836610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:40.836891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:40.837167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:40.844628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:40.846103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:40.859601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 05:45:40.864446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 334/652] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:40.864587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 319/653] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:40.864587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.865303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:40.977105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619274f-f225-4b3a-8e3c-befffe244829 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:40.996481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0535f-b9ad-4b3d-88e9-1a0113b16773 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.011934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.012582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.012865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.013141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.014047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:41.014359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.015852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.034004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 335/654] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:41.034999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.038904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.040167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.040772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.041246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.056283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.058159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.084312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:41.089615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 320/655] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:41.095420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.245211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce000-2fff-49b8-8c5c-a8deacd40f16 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.270728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a770c3-0ff6-4b34-9ba9-c7bee2b5b8d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.299376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.302789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.302789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.302789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.317778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.319559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.324967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.326226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.326705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.327172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.329039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:41.329730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.331432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.341729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:41.343623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 336/656] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:41.344327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.360412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 321/657] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:41.361262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.472363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188971b-aa42-4694-8f18-b52a8680771b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.497188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ad73a-4044-4e40-9308-b273bdb827bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.506753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.507420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.507699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.507972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.508694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:41.508994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.510398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.522779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 322/658] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:41.522779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.536816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.537685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.538110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.538557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.539442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:41.539902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.541271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6b757-74b1-434f-922a-1e1fb19692bb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.553661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 337/659] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:41.554934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6baa4-42d2-478a-9759-e8bd4d663702 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.555223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6baa4-42d2-478a-9759-e8bd4d663702 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.555499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6baa4-42d2-478a-9759-e8bd4d663702 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.557362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 338/660] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:41.558192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6baa4-42d2-478a-9759-e8bd4d663702 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.630812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92f478-91fa-4def-aa7d-04a95e68cc6f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.662403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6baa4-42d2-478a-9759-e8bd4d663702 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.664095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.664744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.665019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.665297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.696235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.697015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.697297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.697604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.704633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.706142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.719462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:41.725381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 339/661] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:41.726008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.730183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.731633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b3387-8a1e-48f7-93ac-14a4f47a3ed8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.821715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4dc-621a-48ac-9ab0-ce6b9ec958b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:41.831759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 323/662] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:41.831759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.831759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.831759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.845448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:41.846629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:41.859314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:41.860317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:41.860741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:41.861156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:41.868264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:41.869975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:41.883727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 05:45:41.885098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 340/663] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:41.885702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.917795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 324/664] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:41.919039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:41.990055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153233a8-cc9a-48c3-888e-d21055932825 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.016710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfd1d3-e4e6-4074-ae87-5c0154a9bccf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.022641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.023294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.023571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.023841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.024613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.024913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.026386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.042890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 341/665] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.042890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.050140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.050934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.051217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.051482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.062036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.063494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.080387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:42.085914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 325/666] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:42.085914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.142914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8b1a5-0d6e-4f70-b240-82b014ea5d05 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.175639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.176309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.176588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.176862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.177722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.177884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1774-f0ad-4e0c-bf09-4b9889a242da None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.178038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.179468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.200255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 342/667] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.200255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.210527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.211319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.211603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.211871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.222704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:42.229716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:42.230903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 326/668] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:42.231662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.302371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1fac-bccf-4c25-b38c-2d56597cd9a6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.328960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55a2d1-b159-48e5-bb6a-6eaa248d5139 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.341355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.341355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.341355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.341355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.342305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=f0d9910443224e84af4396d4b9af0656) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.342305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.342305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.358105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 343/669] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/role_assignments?user.id=f0d9910443224e84af4396d4b9af0656&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.358105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.364018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.364685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.364966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.365238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.366006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.366313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.367722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.385308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 327/670] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.385308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.488584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b155-0299-409c-8519-b52df1c0abbf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.506574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e010e5d-2303-4890-8432-188401e68611 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.523473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.524145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.524426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.524698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.525465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.525794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.527182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.540613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 328/671] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.540613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.557563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.558258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.558539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.558813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.645200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.646704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.657713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9782-89ad-42d5-baf6-8cb0bcf1b5dd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.694464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.695253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.695532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.695804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.703587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.705033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.719456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:42.720865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 329/672] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:42.721881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.758722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 344/673] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:42.764504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.831117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497957-b42e-4418-a6a5-ebfb36e6bf2f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.865168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.865369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412622f-f4c7-4966-9f0e-4bc082411659 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:42.866113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.866456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.866806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.877701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.879086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.896448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:42.897689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 330/674] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:42.902204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:42.906067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:42.906986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:42.907467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:42.907951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:42.908950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:42.909465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:42.911239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:42.923814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 345/675] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:42.924988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.006845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611936b-0b2e-4936-9217-20d242f4abe1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.025035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899e4c-b79f-4f41-b2a1-d893b5ca6929 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.040694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.041504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.041786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.042057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.052137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.053728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.061159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.062081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.062579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.063066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.063975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.064475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.066102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.071446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:43.077698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 331/676] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:43.078503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.080267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 346/677] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:43.086472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.181029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2e6-e28a-4819-8501-6036f0d31bbe None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.195826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef13fb-66b2-4f7b-b66c-095ba9bfa0f1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.217034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.218050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.218522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.219087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.220100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=064fd80565d543dfaca680bebfbb7127) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.220618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.222260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.229240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 332/678] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/role_assignments?user.id=064fd80565d543dfaca680bebfbb7127&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:43.230389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.236812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.237662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.237943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.238217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.249308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.250906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.289387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:45:43.290892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 347/679] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:43.297120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.344727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f536f3-2a52-4ddc-93ad-14bf02ee79f0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.385625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.386597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.387092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.387576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.388538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.389055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.390855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.403626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 333/680] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:43.409580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.507288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c4fda-2abd-4ef1-8b95-e0df485a4b4d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.515375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce993b4c-3b93-44ee-aa54-d44aaa3c63a8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.543120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.544100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.545132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.545674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.546761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.547267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.548960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.550421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.551216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.551498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.551766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.558685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.560938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.573666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 348/681] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:43.574934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:43.576582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 334/682] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:43.581618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.581776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.690552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e6a0-4c0f-4202-9bc4-9583579d4893 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.691722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429ff6-2c97-4ac7-9931-654c0e87d7da None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.724307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.724963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.725240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.725532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.726312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.726612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.728256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544878d-e178-4a7c-a28a-cf8e9c545fcc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.730802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.731453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.731735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.732009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.740331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 335/683] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:43.746307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212842-ace6-4c27-894e-43991a108bcb None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.746605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212842-ace6-4c27-894e-43991a108bcb None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.746887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212842-ace6-4c27-894e-43991a108bcb None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.749390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 336/684] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:43.750153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e212842-ace6-4c27-894e-43991a108bcb None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.805651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.807119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.850250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e212842-ace6-4c27-894e-43991a108bcb None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:43.883186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:43.883832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.884112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.884383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.885196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0b52b24c45b04205922a4394f8eddea1) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:43.885523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:43.886947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a15d-f7dd-4aad-9f06-d25cfd1d8a04 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:43.897750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 337/685] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/role_assignments?user.id=0b52b24c45b04205922a4394f8eddea1&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:43.899172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:43.899462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:43.899739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:43.908385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 349/686] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:43.914267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:43.934715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:43.936989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:44.020789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d236-d81d-4f03-a491-74beb6e8226f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.029737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 338/687] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:44.066877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.092374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be149-6391-488c-8895-23668c7e1171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.093191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be149-6391-488c-8895-23668c7e1171 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.093493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be149-6391-488c-8895-23668c7e1171 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.093785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be149-6391-488c-8895-23668c7e1171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.113640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be149-6391-488c-8895-23668c7e1171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.115132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be149-6391-488c-8895-23668c7e1171 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.150485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-487be149-6391-488c-8895-23668c7e1171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:44.153189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 350/688] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:44.159204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be149-6391-488c-8895-23668c7e1171 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.232827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641af07-3d82-438c-8120-e5064cdc026a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.269201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.270161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.270365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.270645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.278902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be149-6391-488c-8895-23668c7e1171 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.283230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:44.290432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:44.292017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 339/689] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:44.298009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.316842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.317915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.318392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.318856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.319789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:44.320281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.321895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.334435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 351/690] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:44.344164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.408381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951948-4aa6-4872-8c57-e5efb3b2b01c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.445152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.445753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.446056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.446342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.447089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:44.447403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.448808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.452490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bf71-482f-4ebb-aac1-5672c3f4daac None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.458105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 340/691] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:44.463747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.487814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.488951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.489423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.489942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.496904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.498730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.512534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:44.514829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 352/692] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:44.520401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.565984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29537498-4846-4838-ae5a-c64f6adad105 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.614153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.615928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.616212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.616487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.635699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.637197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.672666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:44.674228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 341/693] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:44.679616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.713068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad8d38-27b4-4692-9590-d28cfd1e987a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.781985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0ac7a-320e-4950-9d06-7ee7e618b28c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.814257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.814948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.815230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.815504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.816304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:44.816609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.818166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.818286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.818852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.819139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.819420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.820207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:44.820520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.821988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:44.835253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 342/694] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:44.838630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 353/695] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:44.840786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.845029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:44.940979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824831d4-b9e2-4a0e-9aea-e475b8d4d44c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:44.983844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:44.984636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:44.985349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:44.985661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:44.995038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:44.996484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.009448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471222d-5fdd-438e-a493-921abc0ba6dd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.014878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-1f88210a-cdd9-4bbd-8356-0ddd727c2dd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:45.016758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 343/696] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:45.018008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b8d4-e890-477e-a913-2186f6074e0c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.018296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b8d4-e890-477e-a913-2186f6074e0c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.018578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b8d4-e890-477e-a913-2186f6074e0c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.024833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 344/697] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:45.026336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.026631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.027250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.048933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:45.049869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.050157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:45.050678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.051032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.051389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.052421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=ffe3c9bd5d944466b9b8d1fd3f904026) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:45.052805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.054353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.061098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 354/698] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:44 2022] GET /identity/v3/role_assignments?user.id=ffe3c9bd5d944466b9b8d1fd3f904026&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:45.062195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.137273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 345/699] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:45.162543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.170724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e776d-6ab9-4659-bc81-3c8622215cd2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.208193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.208798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.209081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.209358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.210415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:45.210789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.212250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.232442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:45.237930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.273529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc425d14-84ba-4a82-9bee-b92d14720885 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.309193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.310740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.311029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.311303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.322353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.323918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.343158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:45.344764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 346/701] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:45.348555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1dae-031e-4d17-8d1c-0d810a237f86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.350414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.384135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.384794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.385080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.385359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.457050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cb5e-5a1d-4394-b850-8f5476e73cdd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.469159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.470671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.492664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.493330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.493644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.493924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.494641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:45.494945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.496373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.509331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 347/702] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:45.514720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.574613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 356/703] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 05:45:45.580350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.616043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082993-e7ec-4224-81e7-a755b2c19df8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.650536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.651214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.651566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.652114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.652882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.654402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.691430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc3b1-447b-4969-8470-d84308736cbe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.725595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 348/704] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:45:45 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:45:45.737347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.738374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.738670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.738953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.753339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.755061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.776306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:45.778086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 357/705] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:45.783692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:45.903463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288e12-48e6-4422-be4f-9b854291ac53 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:45.941653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:45.942384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:45.942671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:45.942951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:45.943725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:45.944036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:45.945407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:45.958673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 349/706] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:45.963969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.072399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6a01-8e76-4ed9-947c-1ccae695a8cf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.108352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.109156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.109456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.109746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.117005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.118488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.131826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e94eca71-628d-4ef5-a700-c93c03849fe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:46.133308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 358/707] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:46.139098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.149135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6d77-dc93-4106-b649-9288b17d421d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.149417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6d77-dc93-4106-b649-9288b17d421d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.149726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6d77-dc93-4106-b649-9288b17d421d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.151803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 359/708] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:46.157451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.157746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.158028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.180354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:46.181600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:46.257687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a313-46b2-4560-99a0-5a621276cfb7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.281565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 360/709] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:46.297529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.297960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.298628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.298915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.299194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.300192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:46.301372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.302863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.317698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 350/710] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:46.326302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.423027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee8c5-8196-4cc1-9187-32842310b253 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.440681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae161c9-019d-4de3-98fe-22a905b3ba27 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.468428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.469936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.470629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.471422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] PATH_INFO: `/v3/services/network` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.472567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.474197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.475756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.476412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.476695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.476987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.477824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:46.478137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.479730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.485579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 351/711] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:46 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:46.497512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 05:45:46.497512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 361/712] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:46 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:46.502826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.646495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3586f7-5ffa-478d-8f5e-da7760b22746 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.702276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.703002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.703283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.703564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.704291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] RBAC: Adding query filter params (name=network) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:46.704596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.710040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7bb5-a70f-4162-9766-f8920ab22c06 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.715335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 352/713] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:46.720728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:46.877481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01973-d4ee-4d1e-b25e-d72ce4e31257 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:46.927541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:46.928126 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:46.928404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:46.928674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:46.929379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:46.929706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:46.931091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54d535-91c5-41b6-9e9c-f311aedce0b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:46.942331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 362/714] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:47.113895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1815e-9ae3-4e98-8408-ee449be205d9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:47.114235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1815e-9ae3-4e98-8408-ee449be205d9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:47.114529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1815e-9ae3-4e98-8408-ee449be205d9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:47.116528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 353/715] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:47.122961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:47.123239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:47.123518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:47.145045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:47.146310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:47.229191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 363/716] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 05:45:47.251389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1815e-9ae3-4e98-8408-ee449be205d9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:47.403109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1815e-9ae3-4e98-8408-ee449be205d9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:47.446206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:47.447031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:47.447311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:47.447583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:47.448235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:47.449628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:47.463086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 05:45:47.464557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 354/717] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Aug 23 05:45:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:47.471557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:47.596478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccda45-ddd4-4243-8f1d-11c1b7d4dbd5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:47.646358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:47.647022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:47.647298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:47.647567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:47.648277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:47.648580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:47.649984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55a97-70d0-48dc-8aba-df0368481a75 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:47.657417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 364/718] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:47.662930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:47.784404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e809-0e44-4b8f-9fd4-5365d55b551f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:47.827885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:47.828542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:47.828816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:47.829087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:47.829847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:47.830145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:47.831529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd01e5-9976-402b-a358-0fdb376cfaee None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:47.842461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 355/719] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:48.467533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb154-13f1-45bf-8656-5d1cddf62b18 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:48.468520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb154-13f1-45bf-8656-5d1cddf62b18 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:48.469009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb154-13f1-45bf-8656-5d1cddf62b18 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:48.471119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 365/720] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:48.486145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:48.486430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:48.486864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:48.510451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:48.511911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:48.598641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 356/721] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:48.633532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb154-13f1-45bf-8656-5d1cddf62b18 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:48.788880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb154-13f1-45bf-8656-5d1cddf62b18 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:48.837879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:48.839051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:48.839532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:48.840014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:48.854040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:48.861904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-cdc38cd3-42d0-4284-9b82-91cffd8f82ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:48.863357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 366/722] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:48.869216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.021102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939dff-076c-4a4a-89ad-2a7d1062f578 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.071537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.072209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.072490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.072767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.073535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:49.073838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.075504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.089159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 357/723] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:49.089773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cdea-bca7-48db-a6e2-6e1f0399e15d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.090331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cdea-bca7-48db-a6e2-6e1f0399e15d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.091344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cdea-bca7-48db-a6e2-6e1f0399e15d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.093576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 367/724] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:49.097541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.099198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.099745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.100294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.129542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:49.130794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:49.235592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d7c0-4ded-45e6-9188-39a626c93b1b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.277114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.277902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.278932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.279362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.281663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 368/725] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:49.296364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.298028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.305052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.320479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:49.322321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 358/726] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:49.328452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.443721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914184cf-aa42-4abc-b3ab-577cfdbd1e11 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.483837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.484507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.484789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.485064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.485817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:49.486123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.487491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.510004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 359/727] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:49.517061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.539645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac783d8-a5a6-45df-af43-b8f3f71a8344 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.598293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.599433 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.599945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.600281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.611052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:49.618265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-fa8018e9-cbcc-4d15-ab4d-2b2d1431baf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:49.619951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 369/728] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:49.621370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc588e-492e-4431-a5a5-e6bf8db247be None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.622414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc588e-492e-4431-a5a5-e6bf8db247be None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.622882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc588e-492e-4431-a5a5-e6bf8db247be None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.625009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 370/729] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:49.628389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc588e-492e-4431-a5a5-e6bf8db247be None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.646468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5874-c1d9-4242-bd8b-daf3ac7f417c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.680917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.681970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.682396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.682849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.691014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.692615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.707381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-5e0c260d-f414-4e94-8824-821b540a3120 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:45:49.709097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 360/730] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:49.710653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.711139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.711636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.728536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:49.730029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:49.735625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc588e-492e-4431-a5a5-e6bf8db247be None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.771451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.772166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.772444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.772716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.773543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:49.773845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.775230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.789468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 371/731] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:49.789468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.805664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 361/732] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:49.806844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.891090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61fa1-da34-4851-8f3b-1351658814e1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.907398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724198a0-3e31-44be-b654-1f0189d97ec2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:49.926543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.927228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.927691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.928137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.929271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:49.929774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.931431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.945078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:49.945905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.946188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.946461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.955407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 372/733] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:49.955407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:49.957032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:49.958539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:49.975227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-21d278ed-f926-44c2-8b37-322bc5f03fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:49.976553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 362/734] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:49.977640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734932-a8d2-4944-aeee-f2f7fd807730 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:49.978030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734932-a8d2-4944-aeee-f2f7fd807730 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:49.978291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46734932-a8d2-4944-aeee-f2f7fd807730 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:49.980093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 363/735] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:49.980654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734932-a8d2-4944-aeee-f2f7fd807730 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.074288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f26c05-f70f-4ed2-98fc-124639dae059 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.081169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46734932-a8d2-4944-aeee-f2f7fd807730 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.109375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.110250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.110538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.110825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.115420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.116862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.117284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.117724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.121197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:50.128822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:50.130089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 373/736] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:50.130836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.188663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.190170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.226222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2e56c-8d79-45f8-9222-33fc4b42a4c1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.260621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.261608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.261885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.262160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.262921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:50.263221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.264632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39ac2d-f5c9-4d6a-9a7f-f2937a373869 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.281843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 374/737] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:50.281843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.281843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.281843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.294383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 364/738] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:50.294383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.299347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:50.299347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:50.377548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 375/739] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:50.377548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.405376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c0aa-6f75-4050-a7ce-fef620075df8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.439323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.439983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.440254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.440534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.441269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:50.441601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.442997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.456445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 365/740] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:50.456445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.480400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68003f67-e1e8-492c-9b88-5233fcc6b68f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.514432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.515230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.515504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.515772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.522771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.524216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.538714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:45:50.544475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 376/741] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:50.544475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.557241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fc6a-f667-4442-a35f-cf4325d120b7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.590860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.591662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.591954 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.592212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.602536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.603987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.620188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:50.626400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 366/742] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:50.626400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.639979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd16b-67f3-4b13-8e54-c0f6ba0c4397 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.672252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.672908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.673187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.673475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.674191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.675552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.720805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087ce2-da57-40b4-947e-a800f0bb7a96 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.752584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.753358 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.753669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.753941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.763938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.765367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.767870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 377/743] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:45:50 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:50.768701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.781925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:50.783370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 367/744] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:50.784060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.888300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef2768-4e82-4ed0-b2dd-2c2f3d8c628b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.895880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997e26-1df5-4341-b2f0-4dfb148e48fe None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:50.924418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.925091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.925372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.925690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.926421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:50.926726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.928151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502709e3-69d2-407a-9ad2-824ca955d78c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.932974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:50.934085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.935189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.935654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.936700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:50.937224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:50.938945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:50.941168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 368/745] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:50.942600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4283-a885-400e-a545-e251b88d82a2 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:50.942884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4283-a885-400e-a545-e251b88d82a2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:50.943157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff4283-a885-400e-a545-e251b88d82a2 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:50.947074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 369/746] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:50.947074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4283-a885-400e-a545-e251b88d82a2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:50.965141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 378/747] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:50.966049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.060709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff4283-a885-400e-a545-e251b88d82a2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.064063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01867bb-5c2e-4a42-974e-933db86a47ec None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.095313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.095968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.096247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.096520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.096813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.097276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:51.097606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.097722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.097898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.098171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.098960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffd32e-98ee-4f62-9fe6-42ccbccb6a20 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.104762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.106789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.114896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 370/748] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:51.114896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.114896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.114896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.123245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:51.124585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 379/749] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:51.129407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.135670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:51.137258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:51.203379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 371/750] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 05:45:51.204346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.235647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caccace-df82-47dc-8676-1853104c0615 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.267044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.267687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.267972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.268248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.306938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66de27-2dd4-4ce1-b616-cd3d423d9940 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.332563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.334081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.339236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.340040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.340330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.341117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.348096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.349652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.367060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:51.368258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 372/751] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:51.369011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.488390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 380/752] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 05:45:51.489551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.527521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b7bcd-e66e-4b92-8e6f-35983b2b75cc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.560382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.561036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.561313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.561671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.562453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:51.562758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.564188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.575963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 373/753] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:51.576766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.584615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4a545-89e8-44d2-8466-4caba46a31fb None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.618187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.618849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.619129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.619400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.620117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.621516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.673018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d440-8996-44c6-8f6c-8b92ca0dbb71 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.694419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 381/754] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:45:51 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:51.695495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.734205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.736184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.736657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.737126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.738212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:51.738765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.741037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.767426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 374/755] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:51.768569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.809654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf353e5-ccfe-4c30-9950-68a5de294d46 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.847070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.847988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.848338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.848696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.861078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.863058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.881040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:51.882606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08ad6-49b1-4801-9432-5e1405501bcc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:51.887260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 382/756] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:51.888653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:51.923027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:51.923690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:51.923970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:51.924243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:51.926057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=ffe3c9bd5d944466b9b8d1fd3f904026) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:51.927017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:51.928772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:51.935833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 375/757] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/role_assignments?user.id=ffe3c9bd5d944466b9b8d1fd3f904026&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:51.936617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.000500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf06fc7-7d50-4ee2-95aa-2f5e23c8e78d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.038242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.039054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.039335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.039608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.043990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc96701-6f6a-46bb-8b31-8d24c4b6c553 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.051265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.052756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.072192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:52.073457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 383/758] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:52.082585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.086801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.087478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.087763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.088038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.088757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:52.089131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.090633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.107972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 376/759] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:52.109268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.214249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a412944-9d7e-4551-ae81-b2dec59811d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.246745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3944-d4c6-4fb5-ac9e-06f99e6f667d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.249168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.250007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.250288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.250615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.258134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.259809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.274895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:52.280969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 377/760] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:52.282913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.328851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.329534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.330207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.330207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.333454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:52.333454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.333454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.346606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 384/761] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:52.352599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.405093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad735a-78e3-4e46-84f5-aa19bdc789b6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.442161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.442824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.443106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.443381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.444339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:52.445035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.446500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.459763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 378/762] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:52.467072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.552482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32db97f-fdfb-4083-8690-b2b0fb82c3c6 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.569222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7851c2-ff81-4ee7-87cd-61ed34a456f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.603263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.603924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.604209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.604489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.605317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0c909b1d772d4d58bf5965aceef1c908) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:52.605657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.607132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.612978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 379/763] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/role_assignments?user.id=0c909b1d772d4d58bf5965aceef1c908&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:52.641819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.642700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.642989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.643266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.654168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.655735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.675799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:52.681651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 385/764] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:52.683106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:52.806773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c85f5-2077-496e-80f1-fe49ac0a288c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:52.842180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:52.842844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:52.843127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:52.843401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:52.844185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:52.844491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:52.845951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909b948-b489-4719-a7b8-3c0839427794 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:52.858976 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 380/765] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:52.864980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:53.030807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4fa1-3172-4ae8-8cc0-008571ca388e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:53.079171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:53.079987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:53.080266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:53.080544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:53.082558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=18cdab9833c3477b9c95fb011e629bb0, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:53.083972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725e77-70fd-4073-bfd6-028f7116bbbe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:53.162971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 386/766] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:52 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:53.354294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413347-2480-48f5-a30f-2b703d4210d1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:53.354963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413347-2480-48f5-a30f-2b703d4210d1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:53.354963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90413347-2480-48f5-a30f-2b703d4210d1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:53.357531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 381/767] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:53.362842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:53.363185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:53.363394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:53.385769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:53.386831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:53.462258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 387/768] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:45:53.486172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90413347-2480-48f5-a30f-2b703d4210d1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:53.631919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90413347-2480-48f5-a30f-2b703d4210d1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:53.680657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:53.681470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:53.681754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:53.682025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:53.682670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:53.684085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:53.701273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 05:45:53.702875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 382/769] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:53 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:53.708675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:53.952093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8359-5d59-44e5-857b-0604f55de9d4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:54.031557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:54.032231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.032513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.032784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.033521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:54.033829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:54.035231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:54.046228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 388/770] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:54.051650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:54.187355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf4d6-6e9e-4d8b-a57c-aed11f13d4f4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:54.232649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:54.233316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.233661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.233947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.234646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] RBAC: Adding query filter params (type=network) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:54.234944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:54.236623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:54.245270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 383/771] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:54.251549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:54.395396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48810790-078d-4dd4-8fd5-4dd29c14b588 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:54.440936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:54.441631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.441912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.442184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.442980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] RBAC: Adding query filter params (interface=public, service_id=9d142411014746a38a56666d42c807dd, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:54.443289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:54.444663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8c20-46e9-4bec-aa9f-f3e9d2d916c3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:54.455770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 389/772] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:45:54 2022] GET /identity/v3/endpoints?service_id=9d142411014746a38a56666d42c807dd&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:54.461250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:54.491388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea679bd-887d-4bae-bee0-a461601fd650 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.491975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea679bd-887d-4bae-bee0-a461601fd650 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.492443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea679bd-887d-4bae-bee0-a461601fd650 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.494683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 390/773] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:54.500332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513c1a-c423-4407-8497-018a87248654 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.500886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513c1a-c423-4407-8497-018a87248654 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.501366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513c1a-c423-4407-8497-018a87248654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.521317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-81513c1a-c423-4407-8497-018a87248654 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:54.522857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81513c1a-c423-4407-8497-018a87248654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:54.584867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9c43c-5a60-496e-87fb-14df2eee93da None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:54.624595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:54.625705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.626581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.627043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.628227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:54.629980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:54.636322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 384/774] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:45:54 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:45:54.659030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 391/775] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:45:54.694284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:54.827039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45dbe1-38b1-4992-b97d-18f6b8e7dbdf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:54.862889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:54.864024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:54.864482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:54.864930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:54.865776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:54.867383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:54.879387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 05:45:54.881140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 385/776] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Aug 23 05:45:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:54.886731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81513c1a-c423-4407-8497-018a87248654 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:54.989519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81513c1a-c423-4407-8497-018a87248654 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.028775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.029919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.030444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.030906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.031805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:55.032314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:55.033929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:55.039086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 392/777] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:55.045311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.164067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f5b4-d6f2-47a5-aa83-d9fd760a9e50 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.214702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.215991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.216271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.216542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.217242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:55.217567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:55.218927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad2c3-6f33-489e-bf5b-0ea7b025f090 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:55.225656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 386/778] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:55.231367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.237035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585759b-d812-4a71-8cd6-2d2473c2d159 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.237329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585759b-d812-4a71-8cd6-2d2473c2d159 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.237623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585759b-d812-4a71-8cd6-2d2473c2d159 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.239613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 387/779] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:55.244777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1807-d199-4d78-bbf6-afee1c68379f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.245058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1807-d199-4d78-bbf6-afee1c68379f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.245332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1807-d199-4d78-bbf6-afee1c68379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.273815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3e3a1807-d199-4d78-bbf6-afee1c68379f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:55.276988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e3a1807-d199-4d78-bbf6-afee1c68379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:55.401618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 388/780] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:45:55.407527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e839-2dc2-418f-9d66-f9c348dcb29c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.426578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a8f3-309d-4be9-8728-70a4947c92a6 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.427073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a8f3-309d-4be9-8728-70a4947c92a6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.427511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a8f3-309d-4be9-8728-70a4947c92a6 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.429428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 389/781] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:45:55.434756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.435424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.435965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.448977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.450584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.450926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.451202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.452323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] RBAC: Adding query filter params (interface=public, service_id=9404eb268bcb4569827e7b9637f4805a, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:55.452640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:55.454047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:55.457147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:55.458811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:55.459571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 393/782] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/endpoints?service_id=9404eb268bcb4569827e7b9637f4805a&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:55.460427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.539754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 390/783] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:45:55.541287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.596481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40022-0737-48d5-ac22-aade74442ad9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.637898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.642283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.642780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.643263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.654103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:55.661300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:55.663026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 394/784] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:55.664001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.675244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87827a-3b90-4ec4-9201-6857de80fbef None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.712493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.713555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.714003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.714470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.715447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:55.717152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:55.723669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 391/785] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:55.725039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.780649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659205e-983c-40aa-865a-e25dded0c31e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.816056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.817128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.817592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.818054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.829839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:55.834566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec94141-dde1-4010-bde0-2d89faa3bc6d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:55.837505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:45:55.839068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 395/786] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:55.845401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:55.902777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:55.903463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:55.903745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:55.904188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:55.904953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:55.905261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:55.909044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:55.926610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 392/787] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:55.932568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.022848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5f69-de4e-49cd-838e-1acbdd09fb94 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.053661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06cc2e-b2ec-4e76-932c-d38b89957ed9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.063873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.064559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.064837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.065110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.066302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.066611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.068333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.079316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 396/788] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.084817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.095794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.096819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.097264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.097741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.109713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.111473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.129614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-19e24151-6c06-408d-bf23-6c93e9506f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:56.131451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 393/789] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:56.132875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349ceb-f237-48a3-96e4-1bd381ab1d59 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.133369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349ceb-f237-48a3-96e4-1bd381ab1d59 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.133882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349ceb-f237-48a3-96e4-1bd381ab1d59 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.136061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 394/790] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:56.137044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349ceb-f237-48a3-96e4-1bd381ab1d59 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.206786 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e37f-aa78-453e-902b-5fc4f8e87938 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.241409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.242632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.243117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.243643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.255115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.255509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349ceb-f237-48a3-96e4-1bd381ab1d59 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.257114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.274436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-a809c7ee-8f0c-4567-8d4a-6ae1833c57b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:56.276394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 397/791] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:45:56.277985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.278487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.278968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.291770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.292585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.293533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.293805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.294518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.294818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.296172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.298163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:56.299614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:56.310532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 395/792] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.311370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.373820 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 398/793] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:45:56.375105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.419210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614cb8-072d-43a7-bd2f-d97dc0088b47 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.453023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.453348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.453646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.453920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.454626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.454979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.456410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.468598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 396/794] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.469298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.479710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a49c2-871b-485a-b6ee-732f273e4b75 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.514109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.515251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.515744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.516223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.523827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.525577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.540588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:45:56.542385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 399/795] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:56.544024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.568776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd13e7-6cf8-45a2-a09a-0c9244738dc4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.603402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.604483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.604765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.605037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.618459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:45:56.627810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:45:56.629648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 397/796] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:56.630591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.650368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914989-35bc-41d3-af20-ff3d9c3a7041 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.692026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.693403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.693741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.694025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.705359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.709319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.729002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:45:56.730957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 400/797] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:56.732030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.753936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ec9b-22e7-40b9-93df-24cebeb02f4a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.788380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.788979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.789294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.789639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.790484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.790792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.792239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.814564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 398/798] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.815504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.840705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8076c-4ef9-403a-b657-c19cf7dd2843 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.875415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.876411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.876931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.877422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.878434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.878991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.880584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.890171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 401/799] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.891334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.916688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee30d-9e85-48b4-aa42-e14ee7d759c6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:56.955556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:56.956243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:56.956525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:56.956804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:56.957682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:56.957993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:56.959424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:56.978027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 399/800] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:56.981987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:56.996532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd9e7-acfb-4d0d-b463-b8301a2955c2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.032467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.034227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.034774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.035251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.047905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.049825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.068735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:57.070647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 402/801] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.073500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.088747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b215445-96e5-4783-9b9b-f2d1f1080d99 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.124991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.125837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.126133 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.126420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.137634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.139083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.155913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:57.157479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 400/802] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.158337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.178478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94ef9-a6ae-4c1f-93dc-2abba9446ed4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.212984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.213803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.214089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.214362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.225572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.227022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.244036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:57.249787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 403/803] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.249787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.265570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baeaa7-6d9c-4bd1-bb32-32cb37606e0a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.307904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.308617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.308909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.309188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.310232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:57.310548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.312215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.329519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 401/804] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:57.330634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.377145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab489-0fc7-4167-9300-e0a88b4eb29a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.414521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.415188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.415470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.415753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.416475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:57.416779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.418306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.429843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 404/805] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:57.430490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.443440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5221bf-0594-44b3-ad28-9683221286ea None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.477911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.478571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.478859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.479141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.479853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:57.480186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.481608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c89a-32ea-46cf-8ed0-310eeeadb7dc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 402/806] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dadce-e5f7-4ebf-af78-5cbdabcb7553 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dadce-e5f7-4ebf-af78-5cbdabcb7553 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dadce-e5f7-4ebf-af78-5cbdabcb7553 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 403/807] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:57.497509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dadce-e5f7-4ebf-af78-5cbdabcb7553 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.534661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231aef1-50fb-4e9f-b3ce-43258ed95a6c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.570956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.571670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.571956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.572232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.579700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.581167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.594494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:57.600239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 405/808] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.600239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.606852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dadce-e5f7-4ebf-af78-5cbdabcb7553 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.642161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.642985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.643282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.643549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.651118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.653206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.666505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-601d6461-82cd-4200-b517-7bf874637963 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:45:57.672164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 404/809] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.672164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.672164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.672164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.685173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:57.686390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:57.704728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09927c4-fc78-4d15-a3eb-c69884baab32 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.738961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.739764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.740043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.740312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.747029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.748492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.759560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 405/810] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:45:57.760537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.762649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:57.765480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 406/811] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:57.765480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.864818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9f8e-527b-4cd2-b4ed-5a2ec382a579 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.865731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808ebc8-0839-4006-b278-240280855ba7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:57.899018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.900012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.900120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:57.900606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.900732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:57.900955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:57.901226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.901646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:57.902067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:57.902370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.903139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:57.903641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:57.903806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.905456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:57.919921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 406/812] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:57.919921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:57.923914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 407/813] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:57.928746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.020799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016e5d-71ce-443a-87ff-44f207ca6c51 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.026275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07574-881d-4002-9d62-4b6a8fae5625 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.053855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.054507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.054780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.055049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.055818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:58.056124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.057569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.067077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.068373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.068901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.069335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] PATH_INFO: `/v3/services/network` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.070163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.070830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 407/814] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:58.071598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.072093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.085959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 05:45:58.087364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 408/815] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:57 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:58.088344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.172808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6e7f-0efd-4fc4-b2ab-e34b17647a92 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.196599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30829c42-84c2-4a1c-a7dd-f6c360438a37 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.208160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.209050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.209330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.209645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/ffe3c9bd5d944466b9b8d1fd3f904026/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.211591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=ffe3c9bd5d944466b9b8d1fd3f904026, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.213039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.229383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.234029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.234029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.234029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.287367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 408/816] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:58 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/ffe3c9bd5d944466b9b8d1fd3f904026/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:58.288356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.307252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.309472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.403138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9530-a019-4c8b-a5fc-98309f950083 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.425104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 409/817] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:45:58.425104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.445584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.446812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.447103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.447382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0c909b1d772d4d58bf5965aceef1c908/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.463028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=0c909b1d772d4d58bf5965aceef1c908, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.464542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671cce5-90f5-40cd-8dcb-1f33bc63b3fa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.522228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 409/818] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:45:58 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0c909b1d772d4d58bf5965aceef1c908/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:45:58.527227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778756bd-e05b-4086-9f6a-8d49a75cb2af None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.530978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fea1ff-5089-403f-96d2-193b3efd2442 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.531274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fea1ff-5089-403f-96d2-193b3efd2442 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.531604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fea1ff-5089-403f-96d2-193b3efd2442 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.533482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 410/819] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:45:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:45:58.534287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fea1ff-5089-403f-96d2-193b3efd2442 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.572319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.573131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.573501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.573886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.574982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] RBAC: Adding query filter params (name=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:58.575348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.576885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c63e-9c45-4af0-a625-ed2abba37f7a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.582426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 410/820] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:58.583979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.584415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.584752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.608177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:45:58.609605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:45:58.672660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fea1ff-5089-403f-96d2-193b3efd2442 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.697885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 411/821] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:45:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:45:58.698944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.723075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.725230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.726155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.726687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.740463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.741969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.760981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:45:58.762534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 411/822] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:58.763323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.814955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9d7ea-6f25-4eed-bf38-da84e805d1fc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.848738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.849403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.849728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.850066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.850824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] RBAC: Adding query filter params (type=network) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:58.851136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.852564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.862660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 412/823] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:58.863562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.867535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407578-e462-4a58-a01f-cdbc605553e5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:58.901422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:58.903030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:58.903030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:58.903325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:58.903978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:58.905507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:58.916890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 05:45:58.918947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 412/824] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:58.919785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:58.966668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca92bd-66f3-4991-9efb-4910b4cba263 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.005041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.006035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.006540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.007022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.007886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:59.008344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.009896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.020705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28506d-0283-42f5-a913-854d77b9e131 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.024022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 413/825] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:59.025009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.059508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.060165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.060450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.060730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.061863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.062875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.125021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81deab2-b18a-44c1-90c7-9495170a277b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.161271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.161972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.162259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.162541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.163251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:59.163559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.164929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.169831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 414/826] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:59.173944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.174304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 413/827] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:45:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:45:59.175339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.301755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7147b0-d8a4-40c2-aef3-bba602804ed3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.368432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.369247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.373635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.374026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.398459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.399926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.406476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abadba-06a4-4dcf-bb0c-3ab2c19da8d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.437053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:45:59.439452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 415/828] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:45:59.445341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.462079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.463385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.464788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.465253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.466292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:59.467189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.469290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.481687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 414/829] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Aug 23 05:45:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:59.483591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.567732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f236a-fb39-42af-8f4b-cda430f7891e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.593351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899797a-4374-423e-b200-1c681e73c348 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.603842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.604827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.605302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.605802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.606788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:59.607311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.608935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.622943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 416/830] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:45:59.629511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:45:59.633337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.634038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.634324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.634603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.636727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.637308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca1d88-ec59-4287-97b9-7b67b0909483 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.736069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f74e8-4a88-4416-b300-a75bbd61fcd5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:45:59.763523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 415/831] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:45:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:45:59.787328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:45:59.788534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:45:59.789114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:45:59.789727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:45:59.790844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:45:59.791406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:45:59.793296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81bf2f-37cc-4346-ba67-c88e6c1dda1a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:45:59.801401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 417/832] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:45:59 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:00.701106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad882-01ee-46ff-ba63-2eba2411a2fb None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:00.701284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad882-01ee-46ff-ba63-2eba2411a2fb None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:00.701600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad882-01ee-46ff-ba63-2eba2411a2fb None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:00.703516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 416/833] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:00.708920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:00.709738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:00.710153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:00.728024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:00.729411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:00.795687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 418/834] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:00.820998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad882-01ee-46ff-ba63-2eba2411a2fb None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:00.928244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad882-01ee-46ff-ba63-2eba2411a2fb None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:00.963514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:00.964267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:00.964554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:00.964834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:00.976777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:00.984100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-577b4196-6efe-4f6a-860e-77bf1ce9a491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:46:00.985774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 417/835] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:00.991522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.021404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289841d-853d-405f-a0f2-f27b763fd686 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.021911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289841d-853d-405f-a0f2-f27b763fd686 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.022022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289841d-853d-405f-a0f2-f27b763fd686 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.024151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 418/836] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:01.029573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.029863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.030231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.047293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:01.048550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:01.095499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1202-fbd1-43cc-bb34-e1e363f33407 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.121587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 419/837] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:01.129550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.130432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.130905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.131390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.132404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:01.132910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.134506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.140938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.143998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 419/838] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:01.149542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.239466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076347ac-5f83-4fbb-8201-772b75c302e2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.246250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4273-6764-4e6c-8c7c-59b66f0c5062 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.273948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.274502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.274785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.275061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.279293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.280283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.280775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.281237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.285251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:01.291924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.292730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:46:01.294327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.299070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 420/839] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:01.300420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.311878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:01.317991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 420/840] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:01.319006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.404672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bb34d-cea5-4f77-bc82-9c2bedf62c03 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.421422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c130-afd0-4ad0-afc5-62fcf0b9b17a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.439477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.440205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.440495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.440774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.441618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:01.441928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.443305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.456621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 421/841] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:01.458098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.458408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.459134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.459482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.459825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.460609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:01.460973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.462461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.479049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 421/842] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:01.480756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.560864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d1593-9eba-43c0-a9ba-05b220a6c99e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.583086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37656ec-85cc-4948-a835-69753b1b3abc None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.595290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.596088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.596369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.596650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.608186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.609669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.618318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.619105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.619381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.619647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.627141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.627401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:01.628600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.633167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 422/843] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:01.634441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.642780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 05:46:01.648825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 422/844] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:01.649689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.739213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe3f3f-4079-40d4-b3a7-820390cc7c8d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.773521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.774177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdcf86-c012-4adb-adf7-4d3109a75832 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.774696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.774696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.774696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.775410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:01.775714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.777650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.789739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 423/845] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:01.796828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.819466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.820372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.820658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.820939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.822020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:01.822335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.824898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.851094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 423/846] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:01.858158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.910989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90e24-879f-4ca0-a7e4-922a514e5c7d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:01.947144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:01.947961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:01.949464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:01.949745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:01.958175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:01.959620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:01.975143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:46:01.976613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 424/847] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:01.982266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:01.992120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ce036-4a1f-426e-a2ec-517041533759 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.036530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.037632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.038379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.039061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.081290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b11c75-8185-4a11-8f1a-0fdc10ae42fd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.122334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.123165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.123806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.124199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.124701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.125211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:02.125636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.126691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd4593-ca9e-4cb2-81f1-cf4e53a2d688 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.127405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.153466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 425/848] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:02.157700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.242813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 424/849] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:46:02.242813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9a3fd-e4a4-4095-b6c3-363106ada464 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.242813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9a3fd-e4a4-4095-b6c3-363106ada464 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.242813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9a3fd-e4a4-4095-b6c3-363106ada464 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.242813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 425/850] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:02.244279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9a3fd-e4a4-4095-b6c3-363106ada464 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.262760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeac5d-88a9-41c8-a4a1-4308019a7139 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.295439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.296071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.296348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.296616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.342399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9a3fd-e4a4-4095-b6c3-363106ada464 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.361041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.362522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb26550-4c93-4fb6-a75d-253bdbcfb5ca None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.373959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.374741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.375017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.375288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.385703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.387160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.403867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-6c1afa6a-c0ae-4b11-ba8b-db451b2394b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:02.405032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 426/851] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:02.406220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.406501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.406772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.422978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:02.424136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:02.458456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 426/852] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:02.459855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538cabb-5c08-441d-8b76-82a7d8086fea None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.460144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538cabb-5c08-441d-8b76-82a7d8086fea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.460418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538cabb-5c08-441d-8b76-82a7d8086fea None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.462275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 427/853] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:02.462978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538cabb-5c08-441d-8b76-82a7d8086fea None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.486791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 427/854] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:02.487774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.559155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538cabb-5c08-441d-8b76-82a7d8086fea None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.579050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a80cf-c6f0-4945-82c3-627a1e251325 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.591144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.591787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.592064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.592335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.593085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:02.593337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.594716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c0c-3de1-4685-9bfd-4683488ec424 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.605822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 428/855] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:02.606972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.607255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.607531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.611611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.612396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.612673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.612944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.622675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.623123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:02.624117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.624286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:02.640339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:02.641546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 428/856] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:02.642298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.686956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 429/857] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:02.687777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.736791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c03c-096b-40d2-9e08-bef4b82dd718 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.768503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.769279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.769586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.769859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.770501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.771870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.783131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 05:46:02.784462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 429/858] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:02.785023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.785699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ce68-feb8-4a8b-83ac-6fadf1434544 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.818277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.819174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.819452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.819722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.826936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.828371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.841322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:02.842486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 430/859] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:02.843283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.880269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd06c58-3da7-4f55-b065-7b406f80f0bf None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.912012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.912654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.912935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.913211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.913985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:02.914284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.915644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.926699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 430/860] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:02.927475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:02.935648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a3fc-bbed-4ebd-9109-67fe0ee589ec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:02.967863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:02.968676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:02.968933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:02.969201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:02.969864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:02.971210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:02.982239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 05:46:02.983373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 431/861] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:02.984124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.021297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53ba56-73da-495b-ae68-f664c682ea68 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.055166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.055815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.056092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.056360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.057053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.057888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.059266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.063802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 431/862] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.064674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.082547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf1f6-e444-47c9-8027-b579c94c5a59 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.113220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.113832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.114140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.114411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.115178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.115480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.116886 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.128700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 432/863] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.129495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.157258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3283da-d75c-48b0-a4a4-7002b7f75946 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.188574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.189341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.189644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.189919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.196155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.197620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.210832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:03.211967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 432/864] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:03.212714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.220912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80b5d4-906c-48a8-8988-ec1cbeebf511 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.252534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.253171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.253512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.253748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.254435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.254729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.256076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.260228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 433/865] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.261554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.308354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c332-c276-4d04-a066-01a7a757ddfa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.340304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.340948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.341224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 433/866] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.354265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.360210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2805e3-a648-44e9-a7fc-2929f72146a2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.400600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.401309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.401621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.401899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.402736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=ffe3c9bd5d944466b9b8d1fd3f904026) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.403042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.404520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.411022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 434/867] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/role_assignments?user.id=ffe3c9bd5d944466b9b8d1fd3f904026&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.411884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.487635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c5c2b-9f82-47c8-9c9b-bfe298bbd7ce None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.524475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7fac5-fa9e-4f0f-aa44-a1d1fca22d8a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.532852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.533607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.533888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.534160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.535702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.536020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.537552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.555973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 434/868] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.564926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:03.570907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.571579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.571857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.572127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.572840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.573180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.574955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea838105-3599-45c7-8f33-7bcdd22f1bb0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.580278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 435/869] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:03.678675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317aa97-8f56-499f-b6e0-488a5ffa7a4c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:03.720469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:03.721571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:03.722052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:03.722543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:03.723586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0c909b1d772d4d58bf5965aceef1c908) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:03.724047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:03.725817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868149dc-24ff-4731-895b-0423280ba74c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:03.733171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 435/870] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:03 2022] GET /identity/v3/role_assignments?user.id=0c909b1d772d4d58bf5965aceef1c908&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:05.782570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0daf-0363-4c67-abf6-a1b961a3b93d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:05.783091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0daf-0363-4c67-abf6-a1b961a3b93d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:05.783091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0daf-0363-4c67-abf6-a1b961a3b93d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:05.785237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 436/871] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:05.790463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:05.790914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:05.791014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:05.809286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:05.810579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:05.879528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 436/872] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:05.897472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a80a-207a-4ec9-9031-492c7d556669 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:05.900028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a80a-207a-4ec9-9031-492c7d556669 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:05.900028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a80a-207a-4ec9-9031-492c7d556669 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:05.900515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 437/873] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:05.903144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:05.906397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498695-6afa-4b3f-91ed-221bd454e71c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:05.906914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498695-6afa-4b3f-91ed-221bd454e71c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:05.907405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55498695-6afa-4b3f-91ed-221bd454e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:05.925181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-55498695-6afa-4b3f-91ed-221bd454e71c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:05.926752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-55498695-6afa-4b3f-91ed-221bd454e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:05.994003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 438/874] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:05.995666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44bd4-0bb8-4f43-94f3-115ea7ec4a93 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:05.996145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44bd4-0bb8-4f43-94f3-115ea7ec4a93 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:05.996628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44bd4-0bb8-4f43-94f3-115ea7ec4a93 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:05.998738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 439/875] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:06.000035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454db0e-ed9f-4f2b-9a3f-fb9f18fa0735 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.009463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.009463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.009463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.023190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:06.024390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:06.034320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.034919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.035196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.035468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.036190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.037583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.090180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 440/876] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:06.091041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.134746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 437/877] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:05 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:06.134746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.214116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b06e4-96d8-40ad-a9df-668e65859cf1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.255360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.256183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.256463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.256733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.257394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942dbeb-b254-4c72-a225-2e0ac18fe285 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.257533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.258896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.271272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9948591e-6bdc-4c11-8f4e-1afba687e8c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 05:46:06.272709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 441/878] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:06.274128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1935-94fe-47ec-9e69-fb0058795512 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.274419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1935-94fe-47ec-9e69-fb0058795512 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.274696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1935-94fe-47ec-9e69-fb0058795512 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.280365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 442/879] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:06.280365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1935-94fe-47ec-9e69-fb0058795512 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.295232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.295818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.296160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.296437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.297184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.298618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1e538-173a-4379-9cf3-56d3423ba702 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.384899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1935-94fe-47ec-9e69-fb0058795512 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.401841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 438/880] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:06 2022] POST /identity/v3/services => generated 269 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:06.403205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.403495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.403826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.429608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.430402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.430693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.431061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.431796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:06.432768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.433191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:06.434266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.434964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:06.440421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 443/881] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:06.446026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.513071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 439/882] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:06.536711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.557754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd089a-eed8-44db-a097-066add807233 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.595128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.596848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.596848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.596848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.597084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:06.597390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.598842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.604578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 444/883] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:06.649138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5705dba-79a6-4e52-a190-39b5410775ec None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.688021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.688858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.689138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.689408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.701302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:06.709030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:06.710755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 440/884] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:06.719980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.824063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c71ae-f070-4ef2-b083-c800ee801ee1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:06.858368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:06.859029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:06.859305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:06.859574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:06.860308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:06.860608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:06.862083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:06.870594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 445/885] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:06.876430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:06.978100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c2cb3-7680-40e1-91ea-8304fe0eb9ee None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:07.011921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:07.012711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:07.012991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:07.013263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:07.025346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:07.027382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:07.044095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:07.045585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 441/886] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:07.051160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:07.156405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39305b6b-55cb-4b37-9697-c755c23235eb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:07.190059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:07.190719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:07.191002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:07.191279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:07.191994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:07.192303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:07.193701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:07.206638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 446/887] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:07.212642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:07.311378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd63a-e1f1-4e9d-95e9-5aa633aeb018 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:07.346274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:07.347584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:07.348063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:07.348559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:07.357689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:07.359579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:07.374998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:46:07.377339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 442/888] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:46:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:07.386944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:07.490333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11f96-4aef-4f83-a0cb-f4c76762ab36 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:07.524747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:07.525416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:07.526385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:07.526664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:07.527495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:07.527801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:07.529220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:07.547306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 447/889] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:46:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:07.553232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:07.658102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cc2f9-1a48-45ff-8351-d070bec5afd1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:07.691087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:07.691730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:07.692009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:07.692281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:07.758862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:07.760848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:07.860202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 443/890] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:07 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:46:07.865762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:07.966586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c59537-7125-43e5-a79d-13ecca28c878 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.001209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.002031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.002313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.002584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.012764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.014185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.030842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:08.032406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 448/891] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:08.037930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.145993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df061c60-90a7-4424-b2ac-3b495f36ade7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.188483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.189160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.189460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.189739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.190460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:08.190762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.192148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.204315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 444/892] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:08.209797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.320443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b4ab-ecb6-4d44-9683-382070026e92 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.355542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.356336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.356614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.356885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.363865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.365378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.379118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:08.380650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 449/893] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:08.387044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.491900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528600e-f8f7-494d-a1d0-2b7aab9b6061 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.527072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.528146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.528623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.529119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.530132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:08.530635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.532281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76d773-fffc-44c7-bab2-490f2c79abc9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.545165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 445/894] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:08.551569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.629168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280bf1-ce71-4319-bd35-47fdd9dcbcde None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.629494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280bf1-ce71-4319-bd35-47fdd9dcbcde None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.629819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c280bf1-ce71-4319-bd35-47fdd9dcbcde None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.631655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 446/895] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:08.638334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa93a5-de09-4f45-9ea7-a79d4b5ab1f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.638623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa93a5-de09-4f45-9ea7-a79d4b5ab1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.638903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa93a5-de09-4f45-9ea7-a79d4b5ab1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.655321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-01aa93a5-de09-4f45-9ea7-a79d4b5ab1f8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:08.656502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-01aa93a5-de09-4f45-9ea7-a79d4b5ab1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:08.661233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7cc15-ab1d-44a5-a095-daafc2d38614 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.704638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.705748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.706232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.706765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.708595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] RBAC: Adding query filter params (role.id=0c2d6489c23c401bbeaed682dae17020, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0c909b1d772d4d58bf5965aceef1c908) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:08.709178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.711906 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.720538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 450/896] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/role_assignments?user.id=0c909b1d772d4d58bf5965aceef1c908&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0c2d6489c23c401bbeaed682dae17020 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:08.741881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 447/897] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:08.764845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.850369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0058-c920-45ea-9924-8aef9571e3a0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.851045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0058-c920-45ea-9924-8aef9571e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.851523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0058-c920-45ea-9924-8aef9571e3a0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.854396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 448/898] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:08.860452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.861044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.861579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.877961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd585de-6521-444f-af17-66bd6bcb7322 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:08.879794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:08.880950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:08.924715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:08.925608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:08.925886 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:08.926155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:08.926804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:08.928170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:08.943912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 05:46:08.950910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 451/899] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:08.952610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:08.965319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 449/900] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:08.985615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.050507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ad70-4acd-4c98-a193-2be8f279d0cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.088429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.089099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.089384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.089703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.090631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.090939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.092310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fa09-3af8-43fe-95f9-bdfecc19c68a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.097029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 452/901] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:09.098471 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5547-c731-49de-b89b-820fdcd214ca None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.098761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5547-c731-49de-b89b-820fdcd214ca None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.099038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c5547-c731-49de-b89b-820fdcd214ca None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.100660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 453/902] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:09.104009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c5547-c731-49de-b89b-820fdcd214ca None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.105975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb4026-f178-46b6-b9d0-16bb40e0d4ea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.140315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.141051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.141337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.141642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.142306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.143686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.155340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-04d6871b-a5db-4f6b-819d-b914b05050a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 05:46:09.156846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 450/903] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Aug 23 05:46:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:09.158125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.158416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.158693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.176086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:09.177266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:09.213245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c5547-c731-49de-b89b-820fdcd214ca None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.241499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 451/904] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:09.249664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.249741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.249741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.249741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.249741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.250013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.250013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.253459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.256858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 454/905] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:09.262367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.342797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702761cb-fb12-4938-9d46-2cee5c80e353 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.370256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78595-e4d7-4b2b-b1d7-bcbfb3b3af5b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.376051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.376712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.377000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.377280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.380689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.380689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.380689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.386206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 452/906] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:09.387352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.408041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.408993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.409451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.409736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.410521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] RBAC: Adding query filter params (interface=public, service_id=ba1008c1078c40b0b809ba1cf044434e, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.410835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.412202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.424679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 455/907] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/endpoints?service_id=ba1008c1078c40b0b809ba1cf044434e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:09.424679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.489936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed62f0-8329-4757-b8b0-7df856c19a7f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.523240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.523900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.524178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.524451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.524556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afa815-cb57-4148-99c3-4db9f7777612 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.525180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.527107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.557657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.558338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.558618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.558892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.559588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.559889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.561254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.565936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 456/908] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:09.566689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.608289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 453/909] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:09 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:09.610150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.673088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9125-eb19-484b-a068-e5213512a02b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.716895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.717657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.717943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.718285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.718990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.720493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.727756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 457/910] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:46:09.745056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67990141-76f3-41ac-9f72-a56bfb358a68 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.786057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.787001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.787422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.787839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.788840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] RBAC: Adding query filter params (interface=public, service_id=b226606b463b469eab2870cc3d0448c0, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:09.789322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.790996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732524e-93e8-42ed-99da-4fc91b31b251 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.797718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 454/911] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/endpoints?service_id=b226606b463b469eab2870cc3d0448c0&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:09.809492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:09.921679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0739eb-9571-4d90-a423-712f1bc6177d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:09.957372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:09.957994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:09.958274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:09.958547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:09.959276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:09.960635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2be474-de51-43c6-ac68-3c228e99ecdc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:09.967098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 458/912] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:09 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 05:46:11.104893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41607-415f-4d4d-aa92-62a68928d822 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.105465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41607-415f-4d4d-aa92-62a68928d822 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.105465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41607-415f-4d4d-aa92-62a68928d822 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.107446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 455/913] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:11.112808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.113224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.113417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.131919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:11.133129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:11.200701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 459/914] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:11.222667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f41607-415f-4d4d-aa92-62a68928d822 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:11.324631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f41607-415f-4d4d-aa92-62a68928d822 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:11.358648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:11.359392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.359668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.359935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.370877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:11.378256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:11.379764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 456/915] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:11.385732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:11.484848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0741-6c21-466b-bd18-8c5a7b7b4375 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:11.518350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:11.519023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.519301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.519570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.520301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:11.520603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:11.522006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:11.531058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 460/916] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:11.536965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:11.638357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dda89-89e6-4540-8e7c-0accd5b8912d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:11.673510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:11.674315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.674594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.674866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.686883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:11.688379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:11.708009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:11.713664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 457/917] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:11.715842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:11.820249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9762-ebde-43d1-af26-6e6a652b25ba None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:11.859522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:11.860183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:11.860523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:11.860803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:11.861549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:11.861853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:11.863217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfcef-35ce-48ab-9a16-87bd3fa3c5e0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:11.875283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 461/918] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:11.880514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:11.981502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a169-1b82-4b82-8cf4-1de250f3d2d4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.017145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.018015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.018291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.018562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.028152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.029674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.044745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:46:12.046320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 458/919] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:46:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.051837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.052254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801182-4030-4c1e-93dc-0f38d131019c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.052545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801182-4030-4c1e-93dc-0f38d131019c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.052818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801182-4030-4c1e-93dc-0f38d131019c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.054847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 462/920] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:12.060459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.060745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.061024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.078293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:12.079367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:12.149698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 463/921] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:12.168843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.171354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205772de-eff3-4aaa-9334-544ef9d2b0d2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.206078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.206736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.207011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.207278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.208102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:12.208403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.209867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef82519-f0e6-4384-8942-24593afc1d6d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.231471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 459/922] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:12.231471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa91e0-a055-49df-abd7-0c23c37f0131 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.231471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa91e0-a055-49df-abd7-0c23c37f0131 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.231471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa91e0-a055-49df-abd7-0c23c37f0131 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.231471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 460/923] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:12.234328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa91e0-a055-49df-abd7-0c23c37f0131 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.274999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946df5ed-449e-40c4-9b87-e1de51b4d162 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.310257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.310257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.310533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.310616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.311230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.312614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.324590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-fa7b9fbe-52c4-49cc-b459-1acd383aaf55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 05:46:12.325801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 464/924] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.329620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd241-fc19-4a9c-9dec-96b390332ba8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.329620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd241-fc19-4a9c-9dec-96b390332ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.329620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd241-fc19-4a9c-9dec-96b390332ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.342285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa91e0-a055-49df-abd7-0c23c37f0131 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.345353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9addd241-fc19-4a9c-9dec-96b390332ba8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:12.346605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9addd241-fc19-4a9c-9dec-96b390332ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:12.380541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.381345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.381668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.381922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.392452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.394083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.410394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:12.411564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 461/925] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.412334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.412690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 465/926] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:12.414025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a84a-be5c-4f8c-b0fa-a4f2eef876cc None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.414316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a84a-be5c-4f8c-b0fa-a4f2eef876cc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.414592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a84a-be5c-4f8c-b0fa-a4f2eef876cc None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.416979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 466/927] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:12.417880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a84a-be5c-4f8c-b0fa-a4f2eef876cc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.515208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded0768-efd5-4086-a333-a212e8739b86 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.517266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a84a-be5c-4f8c-b0fa-a4f2eef876cc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.547281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.547931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.548210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.548484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.549063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.549171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:12.549499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.549733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.550013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.550285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.550889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c865fb3-ee5f-406c-aeae-e6b902811eb3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.550977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:12.551309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.552641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.555440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 462/928] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:12.556718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.557007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.557281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.563869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 467/929] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:12.564432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.574639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:12.575821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:12.638729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 463/930] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:12.639537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.656950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e024-3e45-4623-ba3b-80e783149e29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.689575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.690351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.690627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.690898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.691533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.692887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.704508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 05:46:12.705770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 468/931] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.706529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.733595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5557d-b397-4de2-828b-c1b00ece344d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.765484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.766088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.766371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.766650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.767350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:12.767654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.769021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.773567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 464/932] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:12.774332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.802065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e744cea-bc07-465c-b20a-efae5f181d1e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.833721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.834485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.834759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.835030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.841847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.843263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.857055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:12.858220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 469/933] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.858968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.872059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a69aa-096e-46c8-96d4-117aa90d50f8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.904639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.905452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.905734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.906008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.906659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.908013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.919649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 05:46:12.920971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 465/934] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:12.921649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:12.951934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918db3-a87e-4323-9939-14f5a59fb233 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:12.984995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:12.985665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:12.985946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:12.986216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:12.986901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:12.987200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:12.988541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:12.992943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 470/935] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:12.993756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.015879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce960-56a8-48e5-a74e-80c27ac18e07 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.047603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.048247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.048520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.048788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.049595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] RBAC: Adding query filter params (interface=public, service_id=dd7d226f0ac444fe91f7e48bd031b7c4, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:13.049903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.051249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.055980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 466/936] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/endpoints?service_id=dd7d226f0ac444fe91f7e48bd031b7c4&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:13.056733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.089747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935b12-dcaf-43e9-b966-446a1438d317 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.121214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.121887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.122162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.122430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.123198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:13.123496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.124901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.135708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 471/937] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:13.136468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.149266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e396e9-326a-44fd-b4ec-45d45a86a3ef None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.181129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.181800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.182079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.182354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.183050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:13.183350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.184702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.189104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 467/938] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:13.189894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.229683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da097-7ae6-4b7b-b210-fb3e46cec915 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.260679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.261321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.261624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.261898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.262585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:13.262883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.264224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.268764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 472/939] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Aug 23 05:46:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:13.269521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.285352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25181f5-07b8-490c-83c9-a1be77e884d4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.316630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.317331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.317691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.317967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.318700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.320081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.326542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 468/940] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:13 2022] GET /identity/v3/services => generated 1497 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:46:13.327304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.372248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3960c4-9eca-4378-9cf0-c568ab2edbce None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.411523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.412419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.412696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.412968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0c909b1d772d4d58bf5965aceef1c908/roles/0c2d6489c23c401bbeaed682dae17020` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.415305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=0c909b1d772d4d58bf5965aceef1c908, role_id=0c2d6489c23c401bbeaed682dae17020)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.416772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.433895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dc34b-8c1f-4e73-8676-1b85cc24971d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.469504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.470179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.470459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.470732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.471443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:13.471746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.473145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.483377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 469/941] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:13.483377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.491587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 473/942] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:46:13 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/0c909b1d772d4d58bf5965aceef1c908/roles/0c2d6489c23c401bbeaed682dae17020 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:46:13.501587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:13.610884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803859af-64d4-4871-b83c-ab9ff758b95f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.627771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9697ea-cd47-4a25-a4fe-c445cb5c16c8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:13.651065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.651730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.652009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.652281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.653023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.654506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7421570-3e9a-495a-80d4-d94eafd45147 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.666318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:13.667037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:13.667316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:13.667586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:13.668406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:13.669847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27e28-f67e-4aeb-a547-bbb37066520f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:13.738168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 470/943] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:13.779162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 474/944] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:15.708110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f7f-85a2-41fc-9bd6-c20304169c71 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:15.708614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f7f-85a2-41fc-9bd6-c20304169c71 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:15.708614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c7f7f-85a2-41fc-9bd6-c20304169c71 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:15.710660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 471/945] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:15.716768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3055f66-a0f6-4dfb-bf56-997f8c87cec8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:15.717198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3055f66-a0f6-4dfb-bf56-997f8c87cec8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:15.717368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3055f66-a0f6-4dfb-bf56-997f8c87cec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:15.734708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a3055f66-a0f6-4dfb-bf56-997f8c87cec8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:15.735911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a3055f66-a0f6-4dfb-bf56-997f8c87cec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:15.812962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 475/946] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:15.836787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c7f7f-85a2-41fc-9bd6-c20304169c71 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:15.857179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc235b7-40e6-48cb-9ca6-e9514a470fd1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:15.857538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc235b7-40e6-48cb-9ca6-e9514a470fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:15.857813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc235b7-40e6-48cb-9ca6-e9514a470fd1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:15.859826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 476/947] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:15.866662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:15.867062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:15.867439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:15.885731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:15.887186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:15.956892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c7f7f-85a2-41fc-9bd6-c20304169c71 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:15.961830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 477/948] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:15.981563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:15.991187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:15.992589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:15.993611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:15.994367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:15.995516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:15.997631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.012662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 05:46:16.015047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 472/949] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:16.020657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.089956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5c57a-760e-463b-b64e-a9708a6e0365 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.124475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.125665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.126142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.126627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.132266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0543-5cfd-47c4-a014-0134fb9cb454 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.138256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:16.145910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:16.147445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 478/950] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:16.153524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.173726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.174390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.174669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.174942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.175649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:16.175959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.177337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467122-f24f-4387-babc-ac308e5b2a24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.182555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 473/951] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:16.183753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede003a-4636-4491-b8be-c2779b59e418 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.184036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede003a-4636-4491-b8be-c2779b59e418 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.184311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede003a-4636-4491-b8be-c2779b59e418 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.186094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 474/952] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:16.190651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede003a-4636-4491-b8be-c2779b59e418 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.253963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f3ad6-5ade-45a6-bf87-a83bd9d94bff None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.285307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.285992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.286274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.286548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.286752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede003a-4636-4491-b8be-c2779b59e418 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.287282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:16.287586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.288972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59879e4e-8db1-4ee3-81a4-e38786473a1a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.297088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 479/953] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:16.298303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.298586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.298858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.314970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:16.316134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:16.319535 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.320190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.320475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.320752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.321518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:16.321826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.323451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e60472-fdf6-4740-aabc-16b696ef0723 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.328105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 475/954] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:16.329282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfdfb6-abec-436f-b4bc-2047b63a36c6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.329600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfdfb6-abec-436f-b4bc-2047b63a36c6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.329884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfdfb6-abec-436f-b4bc-2047b63a36c6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.331519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 476/955] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:16.332219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfdfb6-abec-436f-b4bc-2047b63a36c6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.382630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 480/956] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:16.383455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.432776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfdfb6-abec-436f-b4bc-2047b63a36c6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.464745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.465550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.465831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.466105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.476215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.478255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.478594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a701-8b13-4326-8fb6-e39a1926b4b2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.494511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d48a9faf-7a8e-4cb0-acfa-03b90b1cbefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:16.495681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 477/957] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:16.496832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.497116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.497389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.517132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.517344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:16.517484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.517484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.517484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.517743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:16.517814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.517814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.577529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 478/958] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:16.578337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.662494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 481/959] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:16.663309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.673776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b7c53-89de-4fb6-a9f1-56b8cf0fa89f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.717125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.717987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.718777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.718777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.719249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.720742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.733473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 05:46:16.740199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 479/960] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:16.740199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.771366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e317bb-be36-4f79-8197-2d395c7d6387 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.811006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.811937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.812215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.812490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.813217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:16.813560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.814956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.827717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 482/961] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:16.828585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.844147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ebfd-7bff-41d4-909b-5608abd421cd None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.880264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.880264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.880264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.880264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.880696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.882069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.883421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.common [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 05:46:16.936976 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a4d6-1589-4acc-8b49-d16a105ffbc1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:16.942260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.sql.core [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 05:46:16.942260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 05:46:16.942260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [parameters: {'id': '2cbf2287a6e843ebbd46cd962570b61e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 05:46:16.942260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 05:46:16.949502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2cbf2287a6e843ebbd46cd962570b61e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2cbf2287a6e843ebbd46cd962570b61e. Aug 23 05:46:16.950998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 480/962] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Aug 23 05:46:16 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:16.951772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:16.970900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:16.971561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:16.971838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:16.972110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:16.972802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:16.973102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:16.974510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:16.984061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 483/963] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:16.984061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.057139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe9a6f-d458-418c-93b1-42c6a06fd847 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.079795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d43f39-98b3-4802-a993-ef8d02df3767 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.090580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.091387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.091755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.092002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.099417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.101141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.112691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.113502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.113784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.114052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.114623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 05:46:17.115781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 481/964] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:17.120920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.121287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.122466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.135750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:17.141792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 484/965] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:17.141792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.221500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383a58-665a-4abe-bb16-6d61ade6c15e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.233160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc620ff-607f-4f3f-95c3-d34e63938cb8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.253246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.253930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.254211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.254488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.255180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:17.255485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.256850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.269795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 482/966] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:17.269967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.270085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.270169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.299722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 485/967] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:17.301159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.384193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d55cd-bf80-44ff-8eb7-fdcfc527d659 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.420800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.421750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.421866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3275b-9c93-411a-b4bd-26e98615d49c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.422295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.422713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.423634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:17.424082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.425764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.449859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 483/968] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:17.459865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.460525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.460804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.461077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.537878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.539416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.647102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 486/969] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:17.652894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.752629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8483ec-6423-412e-a743-c026b90d9459 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.787208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.787995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.788272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.788546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.798708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.800305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.817149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:17.818716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 484/970] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:17.825395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:17.927776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df174-3ac0-46e6-82c5-6a5bb90cd584 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:17.962945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:17.963953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:17.964490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:17.964978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:17.965965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:17.966907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:17.968620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:17.984630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 487/971] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:17.986255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:18.086179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ce12-dd3d-4459-b9d8-c402f7a9ff14 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:18.120435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:18.121680 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:18.122164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:18.122678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:18.129765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:18.131452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:18.145115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:18.146600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 485/972] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:18.152687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:18.252957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff8178-7731-46e1-ba02-99456204f71d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:18.287615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:18.288700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:18.289180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:18.289709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:18.290684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:18.291203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:18.292815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef3d2-9bc8-488f-b4db-5e9765ce6b8f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:18.311192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 488/973] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:18.312864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:18.423506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a360dc-8699-4c9a-ac89-9ad4bef3ef0e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:18.458318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:18.459445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:18.459987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:18.460514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:18.461666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] RBAC: Adding query filter params (role.id=0c2d6489c23c401bbeaed682dae17020, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=0c909b1d772d4d58bf5965aceef1c908) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:18.462204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:18.463909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdb53e-f93e-415e-8e7c-7543249f5d55 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:18.471412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 486/974] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:18 2022] GET /identity/v3/role_assignments?user.id=0c909b1d772d4d58bf5965aceef1c908&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0c2d6489c23c401bbeaed682dae17020 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:19.044198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52cfd-894e-461c-81e9-f0e11c7e0283 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.044739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52cfd-894e-461c-81e9-f0e11c7e0283 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.044739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52cfd-894e-461c-81e9-f0e11c7e0283 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.046764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 489/975] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:19.052159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.052581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.052778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.070527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:19.072860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:19.139905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 487/976] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:19.162271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52cfd-894e-461c-81e9-f0e11c7e0283 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.264369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52cfd-894e-461c-81e9-f0e11c7e0283 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.299074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.300256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.300736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.301206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.302125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.303787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.316980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 05:46:19.318965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 490/977] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:19.325765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.431025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26187-bd08-43ac-9de3-18d9ff173987 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.464412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.465072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.465353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.465649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.466351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:19.466649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.468018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.472904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 488/978] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:19.479160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.582942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296087b6-4fa0-49a5-af4c-18a4d6d0da83 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.619688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.620343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.620622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.620953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.621682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:19.621983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.623351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713969b-71e9-425e-b904-0e16f6ba019e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.628769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 491/979] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:19.634633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.675962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf571dc-9f04-4d5b-807b-d246034bf1da None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.676308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf571dc-9f04-4d5b-807b-d246034bf1da None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.676512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf571dc-9f04-4d5b-807b-d246034bf1da None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.678575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 492/980] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:19.683622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.683910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.684192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.701482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:19.702672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:19.751193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a10a6-2127-482b-a310-14bcfb902512 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.777825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 493/981] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:19.788324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.788980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.789311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.790189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.791044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] RBAC: Adding query filter params (interface=admin, service_id=dd7d226f0ac444fe91f7e48bd031b7c4, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:19.791289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.792661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.794946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.799305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 489/982] 10.222.0.26 () {56 vars in 1249 bytes} [Tue Aug 23 05:46:19 2022] GET /identity/v3/endpoints?service_id=dd7d226f0ac444fe91f7e48bd031b7c4&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:19.804909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:19.897609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf115b18-fac1-4a0a-8c6c-b36145b7c87d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.930597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe724d-e670-4502-ab05-6c903e838b2a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:19.933278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.934148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.934590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.935006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.935857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.937416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.965481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:19.966138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.966416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.966694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.967363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:19.968954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455272a-68f2-4ee7-814e-20092e3480a3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:19.974529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 490/983] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:19 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:46:19.981726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98d92-ff2c-48e9-8907-2698562fd670 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.981726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98d92-ff2c-48e9-8907-2698562fd670 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.981726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98d92-ff2c-48e9-8907-2698562fd670 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:19.981726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 491/984] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:19.983604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:19.983894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:19.984170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.002275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:20.003651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:20.045477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 494/985] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:19 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:20.103813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 492/986] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:20.129758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:20.243972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118b0c8-4451-44c2-8d4e-f350c2364fb0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:20.277308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:20.279171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:20.279171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:20.279171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.279429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:20.280692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:20.282055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.common [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 05:46:20.354068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.sql.core [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 05:46:20.354068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 05:46:20.354068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [parameters: {'user_id': '54ee95b930c5490a947630b913c84deb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 05:46:20.354068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 05:46:20.369800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 05:46:20.371572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 495/987] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Aug 23 05:46:20 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:20.380955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:20.489900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d89f2-70a1-4cca-81b2-7ad5fcb126ea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:20.528856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:20.529627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:20.529915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:20.530194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.539012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:20.541128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:20.557059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-74b7f791-0d22-42ca-96e3-e175fccdc44b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 05:46:20.558635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 493/988] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:20.564607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:20.670683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f78954-03ec-414f-b6a9-eae03756da09 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:20.704890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:20.705603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:20.705941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:20.706225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.707087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:20.707401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:20.709115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bf2be-e034-42d7-ab44-e88995c7f7f2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:20.752463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 496/989] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Aug 23 05:46:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:20.892928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc3d4-1a78-4dab-ab80-a94a67b910a3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:20.893150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc3d4-1a78-4dab-ab80-a94a67b910a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:20.893422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc3d4-1a78-4dab-ab80-a94a67b910a3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.895367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 494/990] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:20.901872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:20.902155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:20.902440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:20.921610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:20.923239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:20.994029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 497/991] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:21.017605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc3d4-1a78-4dab-ab80-a94a67b910a3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:21.117095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc3d4-1a78-4dab-ab80-a94a67b910a3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:21.152801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:21.153539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:21.153820 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:21.154091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] PATH_INFO: `/v3/services/image` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:21.154745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:21.156128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:21.166930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 05:46:21.168306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 495/992] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Aug 23 05:46:21 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:21.174129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:21.269830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0558557-3f16-4fdf-a3fc-228eff614b38 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:21.302451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:21.303110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:21.303388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:21.303658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:21.304361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:21.305193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:21.306618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bada73-4b34-4d54-a045-23711d9886b0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:21.311508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 498/993] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:21.316959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:21.416347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b711c0d-a8eb-494e-92f2-9cff02a01c49 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:21.448260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:21.448912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:21.449195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:21.449638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:21.450190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] RBAC: Adding query filter params (type=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:21.450492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:21.451861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf3d3-5a9d-46d0-bbab-ff18a27623fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:21.456374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 496/994] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:22.333109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ff4a-e4da-4679-beb5-0471937fb39e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.333679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ff4a-e4da-4679-beb5-0471937fb39e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.333679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95ff4a-e4da-4679-beb5-0471937fb39e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.335490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 499/995] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:22.341208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.341655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.341799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.359335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:22.360523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:22.449480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 497/996] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:22.467280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebedad7-b3c2-4e48-b45b-516fcb0d48ca None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.467570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebedad7-b3c2-4e48-b45b-516fcb0d48ca None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.467842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebedad7-b3c2-4e48-b45b-516fcb0d48ca None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.469091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.469786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 500/997] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:22.474786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.475076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.475357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.492470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:22.493701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:22.565486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 501/998] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:22.569666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf371-39dc-4a6f-8f4b-9ebcf97a8946 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:22.589466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.605669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:22.606481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.606984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.607101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.607679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:22.609061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:22.621271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 05:46:22.622513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 498/999] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:22.628327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.686126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1574-99e1-4758-bab2-13b041d41277 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:22.723160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:22.723985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.724267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.724459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a3f7-8bcc-4ec3-b87f-af5dbd044d10 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:22.724571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.725172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:22.728173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:22.740779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 05:46:22.747262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 502/1000] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:22.748430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.760394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:22.761056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.761340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.761668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.762378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:22.762687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:22.764062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:22.769100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 499/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:22.774821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.848370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fc62-e0b9-4855-9d35-f27973e6bc7d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:22.872036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17696a2-4451-4808-a6a3-4cc5818f2e4b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:22.880786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:22.881476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.881741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.882017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.883263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:22.883569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:22.884929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:22.889657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 503/1002] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:22.894985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.905343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:22.906028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:22.906309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:22.906579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:22.907278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:22.907581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:22.908948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:22.919318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 500/1003] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:22.920672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:22.990426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b01a1-587c-4bc3-8128-c7203041a9f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:23.018148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb189-cc9d-474d-9b22-55359cf64562 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:23.023802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:23.024473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.024751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.025021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.025759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:23.026060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:23.027447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:23.032540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 504/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:23.038184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:23.056216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:23.057246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.057708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.058155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.059031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:23.060997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:23.135312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f0fb-f211-49b0-b4bc-70af46ed8988 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:23.142474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 501/1005] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:23.182186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:23.182855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.183134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.183404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.184202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] RBAC: Adding query filter params (interface=public, service_id=47425b753d5a49a8a3dcd1fed6d4809b, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:23.184513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:23.185963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452199-1dd3-4a01-8d00-0911fe16dae9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:23.196334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 505/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:46:23 2022] GET /identity/v3/endpoints?service_id=47425b753d5a49a8a3dcd1fed6d4809b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:23.197714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:23.302887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019d20-d34e-4ac5-8384-a281367f026f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:23.340762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:23.341454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.341980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.346932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.346932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:23.346932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a613-ef00-4f0c-9010-e67896ad25e9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:23.350905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 502/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:23 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 05:46:23.799983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ebf-5cb9-4a3c-a141-c6c2f9157c9b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.800571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ebf-5cb9-4a3c-a141-c6c2f9157c9b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.800571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664ebf-5cb9-4a3c-a141-c6c2f9157c9b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.802489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 506/1008] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:23.807543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce8f30-6ac1-4e71-aa59-586cefe43403 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:23.807841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce8f30-6ac1-4e71-aa59-586cefe43403 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:23.808275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce8f30-6ac1-4e71-aa59-586cefe43403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:23.825463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-72ce8f30-6ac1-4e71-aa59-586cefe43403 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:23.826652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-72ce8f30-6ac1-4e71-aa59-586cefe43403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:23.890005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 503/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:23.913113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664ebf-5cb9-4a3c-a141-c6c2f9157c9b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:24.011340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664ebf-5cb9-4a3c-a141-c6c2f9157c9b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:24.044009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:24.044673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:24.044955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:24.045230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:24.045979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:24.047352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b90ac3-b407-475a-9c67-edad4c042a82 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:24.142062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 507/1010] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:23 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:25.533219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ce-c6f9-4845-8fa2-d814927b7454 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.533786 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ce-c6f9-4845-8fa2-d814927b7454 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.533786 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ce-c6f9-4845-8fa2-d814927b7454 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.535631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 504/1011] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:25.540801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfa78-dccd-4636-93f2-66b477f15f09 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.541233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfa78-dccd-4636-93f2-66b477f15f09 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.541403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfa78-dccd-4636-93f2-66b477f15f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.558795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-449bfa78-dccd-4636-93f2-66b477f15f09 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:25.560018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-449bfa78-dccd-4636-93f2-66b477f15f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:25.630215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 508/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:25 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:25.653713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec23ce-c6f9-4845-8fa2-d814927b7454 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:25.715145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6988-c1aa-474a-ada0-db2481535621 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.715331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6988-c1aa-474a-ada0-db2481535621 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.715541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6988-c1aa-474a-ada0-db2481535621 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.717473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 509/1013] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:25.722216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.726607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.726607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.739253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:25.740556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:25.751869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec23ce-c6f9-4845-8fa2-d814927b7454 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:25.784616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:25.785395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.785707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.785975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.787131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:25.788580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:25.790216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 505/1014] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:25.795755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:25.808625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 510/1015] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:25 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:25.835135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:25.897614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd847-64da-4623-a84d-8aa9877caaaa None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:25.932001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:25.932298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe97e4-c8b2-436e-8978-2fb47e9f85dc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:25.932589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.932872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.933148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.933893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:25.935367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:25.965084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:25.965912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:25.969335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:25.969335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:25.969335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:25.969335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:25.980531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 05:46:25.981921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 511/1016] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:25.988044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:26.081468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 506/1017] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:25 2022] POST /identity/v3/projects => generated 311 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:26.095744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01808-00ba-4ccb-bf76-2612d16c9f9e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:26.134780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:26.135493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.135776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.136054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.136800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:26.137114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:26.138608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:26.144402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 512/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:26.150644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:26.255259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c86b2-5856-46d5-a932-8522d3c872c1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:26.288969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:26.289673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.289960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.290241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.290951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:26.291259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:26.292642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfbfff-5015-48b7-8c14-0dfd427ce682 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:26.297635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 507/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Aug 23 05:46:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:26.303458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:26.409973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a6c22-943d-49ef-9ce4-3c50707f2997 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:26.443733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:26.444386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.444670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.444946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.445723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:26.447378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:26.495025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501839-2f5e-4662-ac9a-26834b6677f9 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.495339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501839-2f5e-4662-ac9a-26834b6677f9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.495622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501839-2f5e-4662-ac9a-26834b6677f9 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.497420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 508/1020] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:26.502461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.502759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.503028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.519732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:26.520844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:26.547632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 513/1021] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:26.600389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 509/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:26.625267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:26.732539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981abe54-ab31-4c8f-b3b7-af8b16fa2f79 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:26.766912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:26.767694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.767971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.768241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.768874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:26.770351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:26.781730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 05:46:26.782918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 514/1023] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Aug 23 05:46:26 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:26.789073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:26.887044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65eeff-5b85-4009-a683-3dddeee5186c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:26.920058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:26.920720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:26.920996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:26.921265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:26.922001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:26.922303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:26.923690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:26.933053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 510/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:26.934593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:27.033350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701341b-682f-4c94-a703-da2e765ff7c0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:27.065802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:27.066463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:27.066745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:27.067023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:27.067731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:27.068038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:27.069461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:27.075121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 515/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:27.080929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:27.175715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52978e0-b4ca-4728-8157-067602baf7a9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:27.209160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:27.209847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:27.210281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:27.210560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:27.211348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] RBAC: Adding query filter params (interface=public, service_id=e056cbe152e046dd8f366283f788eda0, region_id=RegionOne) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:27.211682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:27.213073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf67fd-0c12-4463-9227-c7606ce8d502 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:27.218093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 511/1026] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:46:27 2022] GET /identity/v3/endpoints?service_id=e056cbe152e046dd8f366283f788eda0&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:27.223539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:27.321470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9246e-3c4c-4fd1-a474-2adef5da12d8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:27.354491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:27.355150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:27.355434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:27.355773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:27.356478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:27.357865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2006a-03a3-4e9f-809e-3d62fd3bde35 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:27.373533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 516/1027] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:46:27 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:46:28.476749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9821b-7036-4a9f-a4df-a459047bbc28 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:28.477288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9821b-7036-4a9f-a4df-a459047bbc28 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:28.477288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9821b-7036-4a9f-a4df-a459047bbc28 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:28.479164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 512/1028] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:28.484523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:28.484940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:28.485143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:28.503095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:28.504314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:28.572227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 517/1029] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:28.597210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9821b-7036-4a9f-a4df-a459047bbc28 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:28.700850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9821b-7036-4a9f-a4df-a459047bbc28 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:28.733184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:28.733998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:28.734283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:28.734556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:28.735727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:28.737165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd6fd7-bfb5-4100-ada8-ba02c8e8e3a1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:28.739017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 513/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:28.745018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:28.840203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6eb96-244b-440f-b909-5f397ca0dd11 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:28.873402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:28.874146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:28.874433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:28.874707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:28.875416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:28.876869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:28.995438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2272-7fc9-4272-9cc8-a258ab73f267 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:28.995726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2272-7fc9-4272-9cc8-a258ab73f267 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:28.996004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2272-7fc9-4272-9cc8-a258ab73f267 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:28.997893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 514/1031] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:29.002908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.003101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.003365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.010217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 518/1032] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:46:28 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:29.021734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:29.023293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:29.095857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 515/1033] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:29.120776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.222618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4a416-0970-428e-982e-84f04d4af9e9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.257719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.258771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.259216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.259651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.270006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:29.277720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:29.279433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 519/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:29.285345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.392005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcf118-cd9b-483d-89cd-48d261cf3ae1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.450618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.451283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.451562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.451834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.452580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:29.452881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:29.454323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:29.463081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 516/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:29.468877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.564247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60382481-4fbb-4248-9aba-0734e719995d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.595775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.596556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.596833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.597102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.607795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:29.609240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:29.624856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-d858564b-8ae4-4051-8d85-570215eb23f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:29.626221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 520/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:29.631707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.698825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c5ae-e2ab-465d-aa4b-954547274c23 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.699111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c5ae-e2ab-465d-aa4b-954547274c23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.699404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c5ae-e2ab-465d-aa4b-954547274c23 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.701140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 521/1037] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:29.705852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.706135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.706412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.724244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:29.725462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:29.732481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14250ffc-d35a-4b44-b710-9cca109bf1c7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.766560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.767214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.767492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.767765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.768482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:29.768779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:29.770188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:29.782365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 517/1038] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:29.788200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.799937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 522/1039] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:29.823024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.883865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4b10-a9e5-42dc-aa23-00e62972ac9c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.916698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85563fbb-0e97-4fe6-9424-1536d4dbe131 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:29.920091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.920883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.921160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.921447 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.928544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:29.930017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:29.943422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:46:29.945275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 518/1040] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:29.950881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:29.951410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:29.952197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:29.952479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:29.952749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:29.953598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:29.955781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:29.969669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 05:46:29.975659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 523/1041] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:29.976623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.049473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440393c3-c456-48f1-8a8b-1eabbee98156 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.076154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a5a1-eca8-4745-ae6b-7f0e1fb99fa2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.084583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.085591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.085874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.086159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.087024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:30.087332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.088768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.105988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 519/1042] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:30.111178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.113525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.114255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.114548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.114830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.115532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] RBAC: Adding query filter params (name=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:30.115837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.117793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.122742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 524/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:30.128155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.210703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2205a-c8f7-4f48-b004-82c0f3d074ab None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.226154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ef253-6f9a-465c-8278-df85ce6b71ba None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.249371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.250620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.250911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.251186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.260431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.261097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.261387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.261695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.262403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] RBAC: Adding query filter params (type=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:30.262709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.264088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.268851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 525/1044] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:30.274483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.322932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.324385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.374675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efe26-8aca-4e54-a684-29d2f4bcbf08 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.414778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.415675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.416147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.416479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.417245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.418656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.427383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 520/1045] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:30.433281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.497482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 526/1046] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:46:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:30.539266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fcfc1-03bf-433d-bdff-742edbe53089 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.582335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.583138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.583416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.583685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.595403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.596989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.614928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:30.616426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 521/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:30.622184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.727612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df120d-f579-4b68-90cf-a1bfd9345cec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.760138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.760797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.761077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.761351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.762101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:30.762406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.763773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.780519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 527/1048] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:30.782123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:30.877747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5842d39-5aca-49d3-bc17-1830d00c97a8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:30.910056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:30.910844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:30.911124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:30.911396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:30.918558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:30.919999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:30.932699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:30.934051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 522/1049] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:30.939740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:31.033479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18698cd-1238-4c4e-a740-a9015ef6f808 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:31.067038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:31.067712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.067997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.068266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.069099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:31.069403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:31.071155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e898-8cd3-48d8-99ba-453e9daf69db None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:31.089480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 528/1050] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:31.091052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:31.185902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f088070-6e08-4ad0-b5a0-86abd28e6883 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:31.218912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:31.219563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.219844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.220117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.220943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] RBAC: Adding query filter params (role.id=0c2d6489c23c401bbeaed682dae17020, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:31.221257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:31.222719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0282611-6d2e-4292-b22b-474f5df7b2f0 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:31.228237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 523/1051] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:31 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0c2d6489c23c401bbeaed682dae17020 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:31.431146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee191b-96e0-48fa-a69a-5d4718cc49e6 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.431491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee191b-96e0-48fa-a69a-5d4718cc49e6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.431706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee191b-96e0-48fa-a69a-5d4718cc49e6 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.433513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 529/1052] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:31.439129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.439420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.439701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.457094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:31.458301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:31.521711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 524/1053] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:31.545259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee191b-96e0-48fa-a69a-5d4718cc49e6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:31.642656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee191b-96e0-48fa-a69a-5d4718cc49e6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:31.676914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:31.677730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.678012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.678308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.688441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:31.695271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:46:31.696912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 530/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:31.702845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:31.795663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0686-281a-4c51-a0a1-9c5541612129 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:31.826994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:31.827653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.827933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.828206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.828946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:31.829256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:31.830654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:31.839077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 525/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:31.844706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:31.938088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f2ad5-b82d-44a0-bbad-d76875198b3c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:31.970232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:31.971098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:31.971376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:31.971651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] PATH_INFO: `/v3/users/6628f2705cc048888bdbbeea51fe3421` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:31.985005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] RBAC: Authorizing `identity:get_user(user_id=6628f2705cc048888bdbbeea51fe3421)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:31.986467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:31.988282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 531/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:31 2022] GET /identity/v3/users/6628f2705cc048888bdbbeea51fe3421 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:31.994517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:32.093204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce7a-1d5b-45e2-9c42-213ed43d3df1 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:32.124977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:32.125664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:32.125944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:32.126214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:32.189805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:32.191226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:32.284650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 526/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:32.290528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:32.391104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef670-c405-456a-adc3-d685e23998ac None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:32.424077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:32.424932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:32.425240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:32.425541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:32.426701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:32.428686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328ff0-f65f-4238-8c83-0e16f866c740 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:32.435226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 532/1058] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:32 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:32.436417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:32.532810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515211-6f1d-41e6-ac64-4fd80d623a24 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:32.565138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:32.565814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:32.566097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:32.566369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:32.567194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784, user.id=6628f2705cc048888bdbbeea51fe3421) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:32.567503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:32.569588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df8bc-d04c-4c2f-8cc0-ebf5ed2bd36b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:32.575131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 527/1059] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:32 2022] GET /identity/v3/role_assignments?user.id=6628f2705cc048888bdbbeea51fe3421&scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:32.848497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eff3-a63b-44cf-9c01-8b43c178819d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:32.849019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eff3-a63b-44cf-9c01-8b43c178819d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:32.849019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eff3-a63b-44cf-9c01-8b43c178819d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:32.851290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 533/1060] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:32.856496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:32.856894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:32.857036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:32.873984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:32.875145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:32.941591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 528/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:32.961315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833eff3-a63b-44cf-9c01-8b43c178819d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:33.057630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833eff3-a63b-44cf-9c01-8b43c178819d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:33.091109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:33.091739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.092015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.092282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.155644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:33.157020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:33.259997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 534/1062] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:46:33.261399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:33.356327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550ffb3-aad2-45e5-8a5e-466a63db6a27 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:33.390019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:33.390850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.391129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.391400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.402212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:33.403672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:33.421030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-9fee6e1a-157c-49f0-95a0-c94b3a307c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:33.426917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 529/1063] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:33.428161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:33.524259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a32c3-649e-4c23-9af7-b0bfd4014c54 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:33.543366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac03e1-3808-4814-9a72-501343612882 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.543695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac03e1-3808-4814-9a72-501343612882 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.543917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac03e1-3808-4814-9a72-501343612882 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.545881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 530/1064] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:33.550718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.551005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.551301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.556343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:33.557046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.557381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.557684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.558392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:33.558692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:33.560036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:33.569354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:33.570822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:33.574970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 535/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:33.641917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 531/1066] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:33.665684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:33.768952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b3f5a-7f0c-4c66-b60e-440efb59e106 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:33.803683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:33.804497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.804776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.805046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.816310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:33.824689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:33.825911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 536/1067] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:33.832264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:33.929094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99952-a9ee-4a09-9673-9520566bd5f8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:33.960600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:33.961247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:33.961545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:33.961813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:33.962546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:33.962844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:33.964205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:33.971687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 532/1068] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:33.977592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.072344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1416-4332-46b2-82dc-a2fa04c9502c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.103809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.104594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.104905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.105184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.114753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.116760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.133510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:34.134655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 537/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:34.140313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.235427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537720c-bef8-40b7-9033-67b7e9cabf70 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.266855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.267500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.267775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.268041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.268747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:34.269044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.270426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.281693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 533/1070] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:34.287810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.384631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023707b-5be8-4725-85ad-41efe7f774cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.416662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.417462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.417741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.418011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.425339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.426786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.440243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:46:34.441646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 538/1071] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:34.447394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.540648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195aed-3218-4a94-91c0-f8d0594c35ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.574898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.575582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.575861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.576142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.576989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:34.577295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.578802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.596845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 534/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:34.602999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.696011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca6be-0d6f-4448-b21b-3e47a0d36ddf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.727871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.728639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.728916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.729186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.739069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.740526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.756045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:34.757186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 539/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:34.763012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.856413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc4880-ca6e-4e57-8838-97eab24d96ca None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:34.887677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:34.888323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.888601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.888871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.889616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:34.889944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:34.891309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb97b46-def1-487d-a808-bf0a62caf82e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:34.902406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 535/1074] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:34.907944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:34.925245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034723d3-a5ec-4081-a37d-35ff20533819 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.925562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034723d3-a5ec-4081-a37d-35ff20533819 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.925841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034723d3-a5ec-4081-a37d-35ff20533819 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.927576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 536/1075] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:34.932599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:34.933140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:34.933140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:34.950890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:34.951996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:35.002338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b3285-05e4-4531-9a2b-cafd6c707b4e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.013922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 537/1076] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:35.034002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.034780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.035057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.035328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.036641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.041874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.043315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.056302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:35.057458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 540/1077] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:35.063115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.127917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1529cfb-f8ab-4e35-8033-740a341b2a51 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.154661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977cfcf-07a6-4b36-9d8c-f078dc72e0e3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.160213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.160994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.161273 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.161583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.171237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:35.178087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:46:35.179238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 538/1078] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:35.185068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.186548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.187187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.187629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.187904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.188678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:35.188978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.190438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.202705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 541/1079] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:35.208552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.282618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830999e-628a-4ede-92ce-8150e1c95c89 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.301466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121f7b-cf77-462d-9543-d677f632436d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.314127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.314784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.315068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.315341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.316082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:35.316386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.317828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.326431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 539/1080] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:35.332313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.337173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.338085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.338362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.338633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/0c2d6489c23c401bbeaed682dae17020` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.340823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=18cdab9833c3477b9c95fb011e629bb0, role_id=0c2d6489c23c401bbeaed682dae17020)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.342276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.408550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 542/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:46:35 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/18cdab9833c3477b9c95fb011e629bb0/roles/0c2d6489c23c401bbeaed682dae17020 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:46:35.425453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce38d-45bb-4b51-bbdf-9764b14202ee None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.461304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.462139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.462419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.462690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] PATH_INFO: `/v3/users/6628f2705cc048888bdbbeea51fe3421` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.464139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] RBAC: Authorizing `identity:get_user(user_id=6628f2705cc048888bdbbeea51fe3421)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.465698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.467434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 540/1082] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:35 2022] GET /identity/v3/users/6628f2705cc048888bdbbeea51fe3421 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:35.473538 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.574208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eca0b-f324-4f41-9a46-dec0ed93b5ca None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.608714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.609593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.609874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.610142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.611298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.612714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea461f55-5ab8-4b7b-a02a-98e35d1c3c05 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.614406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 543/1083] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:35 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:35.620753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:35.713401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9571-63e1-49f1-a372-4cb204a3348a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:35.745282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:35.746198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:35.746478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:35.746752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784/users/6628f2705cc048888bdbbeea51fe3421/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:35.748685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad5b814ae1f4fc29ce2718586ec8784, user_id=6628f2705cc048888bdbbeea51fe3421, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:35.750154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3ec02-a122-4b37-8ee2-3089f007aa19 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:35.837610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 541/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:46:35 2022] PUT /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784/users/6628f2705cc048888bdbbeea51fe3421/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:46:37.707932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0991-7377-43ae-bb0e-e863cd958c2d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:37.708423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0991-7377-43ae-bb0e-e863cd958c2d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:37.708423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0991-7377-43ae-bb0e-e863cd958c2d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:37.710249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 544/1085] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:37.715456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:37.715857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:37.716025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:37.732599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:37.733842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:37.800513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 542/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:37.825067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f0991-7377-43ae-bb0e-e863cd958c2d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:37.921679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f0991-7377-43ae-bb0e-e863cd958c2d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:37.953494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:37.954300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:37.954582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:37.954856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:37.965068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:37.972410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-495d00dc-f43d-42e3-af61-6400b5a46494 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 05:46:37.973618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 545/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Aug 23 05:46:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:37.980014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.073882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f9d29-2f55-4122-b3d5-846cb7ac68da None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.105764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.106419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.106699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.106974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.107719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:38.108023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.109404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.117815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 543/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:46:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:38.118098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca4cf-fbfd-419f-97ba-aaaa6b737ef9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.118453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca4cf-fbfd-419f-97ba-aaaa6b737ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.118799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca4cf-fbfd-419f-97ba-aaaa6b737ef9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.120678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 546/1089] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:46:38.125253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.125570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.125863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.126148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.142359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:38.143570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:38.208042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 547/1090] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 05:46:38.217673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190713ec-13e9-4db9-8c1b-e7658187d115 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.231756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.250286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.252558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.253724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.254009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.264701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.266180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.282053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:38.283214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 544/1091] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:38.289288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.325893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6f4dd-d828-4ddf-87be-0f26bacb0b7e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.360947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.361796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.362080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.362356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.372673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:38.379831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:46:38.381078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 548/1092] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:38.386982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.388978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070b8c-40c1-491b-a480-a49d9447c50b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.421328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.422667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.422667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.422667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.423217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:38.423549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.424871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.436206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 545/1093] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:38.441804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.482203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7569fc-e7e4-4d35-892c-9d45c4f3be34 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.512897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.513558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.513840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.514109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.514837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:38.515138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.516508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.526155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 549/1094] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:38.531941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.537419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfdbd9-4097-495e-9817-4b8844794850 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.569424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.570578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.570855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.571122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.577924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.579356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.592942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 05:46:38.594191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 546/1095] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:38.600267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.625196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de8b1-689a-47d2-829d-d45496f504da None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.657080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.657977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.658257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.658530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] PATH_INFO: `/v3/users/6628f2705cc048888bdbbeea51fe3421` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.659725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] RBAC: Authorizing `identity:get_user(user_id=6628f2705cc048888bdbbeea51fe3421)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.661143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.663318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 550/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/users/6628f2705cc048888bdbbeea51fe3421 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:38.669024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.692430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7671f-7ed2-49dc-ab38-1f2d94efb58a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.726911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.727560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.727838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.728107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.728926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:38.729228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.730730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.746866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 547/1097] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:38.752409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:38.764478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405ed66-16af-4802-a022-0278e50a8030 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.796690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.797323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.797639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.797916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.844979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ebc4-315c-4eb0-96a8-0b74164a246a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:38.860306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.861771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.876474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:38.877107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:38.877392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:38.877699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:38.940761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:38.942244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:38.952737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 551/1098] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:38.958999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.034256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 548/1099] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 05:46:39.039798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.048532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d14f7-cc2e-4400-adda-fc04372ee9d5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.080878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.081741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.082018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.082294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.083474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.084889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.086733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 552/1100] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:38 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:39.092409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.131757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69a34a-6e7f-4482-88a4-b689afaa436e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.162548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.163312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.163589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.163860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.173185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.174647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.183169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7877eb-75fe-468a-bb2d-b5f39fa3ff64 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.191007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:46:39.192156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 549/1101] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:46:39.198636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.215271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.215908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.216182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.216451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.217254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784, user.id=6628f2705cc048888bdbbeea51fe3421) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:39.217596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.219021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.233536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 553/1102] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/role_assignments?user.id=6628f2705cc048888bdbbeea51fe3421&scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:39.297596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5ae28-3b6c-4561-9b6a-8bf9224e84d5 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.333341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.334043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.334333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.334609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.335344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:39.335652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.337051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.349133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 550/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:39.354763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.455691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d007d-c65c-4ed4-9fc5-78b888ba25a1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.487710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.488492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.488770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.489041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.495987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.497403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.509860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:46:39.511066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 554/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:39.516942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.614142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4018-3249-4b5b-bf21-116946e2f074 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.645348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.646044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.646322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.646593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.647368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:39.647671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.649107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52c5ea-f8ad-48f5-9a3a-43ce90b9e1fe None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.660371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 551/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:39.666828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:39.760431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601365a-74e3-41a1-b567-0b01c7362704 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:39.791662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:39.792300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:39.792580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:39.792855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:39.793690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] RBAC: Adding query filter params (role.id=0c2d6489c23c401bbeaed682dae17020, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=18cdab9833c3477b9c95fb011e629bb0) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:39.794000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:39.795415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cfd80-31b0-4201-aac6-4017e2a62f56 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:39.800912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 555/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:39 2022] GET /identity/v3/role_assignments?user.id=18cdab9833c3477b9c95fb011e629bb0&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0c2d6489c23c401bbeaed682dae17020 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:41.565326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420c13-4099-4318-a43e-1491fb60b2df None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:41.565869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420c13-4099-4318-a43e-1491fb60b2df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:41.565869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420c13-4099-4318-a43e-1491fb60b2df None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:41.567848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 552/1107] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:41.573127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:41.573567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:41.573735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:41.590701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:41.591854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:41.655862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 556/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:41.680006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37420c13-4099-4318-a43e-1491fb60b2df None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:41.776115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37420c13-4099-4318-a43e-1491fb60b2df None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:41.807272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:41.808042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:41.808327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:41.808607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:41.809794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:41.811265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0043af-b134-446a-81ab-05f1656f387a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:41.812840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 553/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:41.819050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:41.916716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f5a7-9b13-48be-9cbd-fe75722199c1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:41.950270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:41.950913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:41.951192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:41.951469 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:41.952155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:41.953685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f006d-93b6-41a7-807d-31bcfe71fd1c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:42.041018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 557/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:46:41 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:44.378111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc7d3-4158-4561-94dd-0737e363bb43 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:44.378668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc7d3-4158-4561-94dd-0737e363bb43 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:44.378668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dc7d3-4158-4561-94dd-0737e363bb43 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:44.380354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 554/1111] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:44.385720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:44.386146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:44.386281 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:44.403549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:44.404704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:44.467393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 558/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:44.492031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dc7d3-4158-4561-94dd-0737e363bb43 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:44.586962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dc7d3-4158-4561-94dd-0737e363bb43 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:44.619541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:44.620378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:44.620658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:44.620930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] PATH_INFO: `/v3/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:44.622405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] RBAC: Authorizing `identity:get_role(role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:44.623774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:44.625112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 555/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:44 2022] GET /identity/v3/roles/ace62a47cba3428196ca1286882b1fae => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:44.630872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:44.723517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122881d5-c286-4530-933d-e5134efc2d12 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:44.755431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:44.756283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:44.756564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:44.756840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] PATH_INFO: `/v3/users/6d08b284ff94402393e1934b991ffd71` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:44.769935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=6d08b284ff94402393e1934b991ffd71)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:44.772001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:44.773636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 559/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:44 2022] GET /identity/v3/users/6d08b284ff94402393e1934b991ffd71 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:44.779250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:44.871946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531405a-1795-4eaf-b613-411e951762b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:44.903784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:44.904379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:44.904663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:44.904939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:44.967211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:44.968643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:45.059289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 556/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:46:45.064845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:45.280393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd349b-700a-43c3-8596-c409f1718bb4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:45.311653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:45.312481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:45.312756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:45.313025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:45.314194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:45.315657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12dbad-d28b-4007-8a79-d3e1f4e9a84c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:45.317300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 560/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:45 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:45.323702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:45.423401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a3ec5-b7b3-4f74-b7d7-fe744944ae69 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:45.455015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:45.455645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:45.455924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:45.456195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:45.457008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784, user.id=6d08b284ff94402393e1934b991ffd71) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:45.457311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:45.459314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6d195-e13c-4148-8bda-0e4f51d5b1c1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:45.464383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 557/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:45 2022] GET /identity/v3/role_assignments?user.id=6d08b284ff94402393e1934b991ffd71&scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784&role.id=ace62a47cba3428196ca1286882b1fae => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:47.757277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fa60-5206-41b4-8436-cd4d91ea2399 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:47.757840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fa60-5206-41b4-8436-cd4d91ea2399 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:47.757945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4fa60-5206-41b4-8436-cd4d91ea2399 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:47.759647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 561/1118] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:47.764817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:47.765229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:47.765360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:47.781130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:47.782352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:47.844125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 558/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:47.867341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4fa60-5206-41b4-8436-cd4d91ea2399 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:47.961161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4fa60-5206-41b4-8436-cd4d91ea2399 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:47.993107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:47.993960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:47.994239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:47.994509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] PATH_INFO: `/v3/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:47.995963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] RBAC: Authorizing `identity:get_role(role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:47.997315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:47.998657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 562/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:47 2022] GET /identity/v3/roles/ace62a47cba3428196ca1286882b1fae => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:48.004172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:48.096168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1e2a-377f-49ba-8f7f-4b85b225e409 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:48.126925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:48.127776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:48.128052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:48.128321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] PATH_INFO: `/v3/users/6d08b284ff94402393e1934b991ffd71` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:48.129526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] RBAC: Authorizing `identity:get_user(user_id=6d08b284ff94402393e1934b991ffd71)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:48.130945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:48.132522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 559/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:48 2022] GET /identity/v3/users/6d08b284ff94402393e1934b991ffd71 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:48.138534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:48.232057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea69d2-eb1e-49e1-bae3-d3400e968f46 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:48.262896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:48.263723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:48.264003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:48.264275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:48.265428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:48.266864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987700-391d-4e69-888d-5b8bcc0223ed None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:48.268489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 563/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:48 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:48.274649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:48.367784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5ff20-026a-4b74-b4d3-697dc7db4d99 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:48.399260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:48.400132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:48.400412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:48.400686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784/users/6d08b284ff94402393e1934b991ffd71/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:48.402880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad5b814ae1f4fc29ce2718586ec8784, user_id=6d08b284ff94402393e1934b991ffd71, role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:48.404306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80614f78-f24e-40fb-ae22-c2ad3acbf279 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:48.526931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 560/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:46:48 2022] PUT /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784/users/6d08b284ff94402393e1934b991ffd71/roles/ace62a47cba3428196ca1286882b1fae => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:46:50.804669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460732d-962c-47c7-a2fa-822940a0f4ac None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:50.805182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460732d-962c-47c7-a2fa-822940a0f4ac None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:50.805298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460732d-962c-47c7-a2fa-822940a0f4ac None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:50.807034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 564/1124] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:50.812357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:50.812760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:50.812903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:50.829961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:50.831120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:50.892758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 561/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:50.916426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460732d-962c-47c7-a2fa-822940a0f4ac None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:51.011377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460732d-962c-47c7-a2fa-822940a0f4ac None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:51.042960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:51.043768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:51.044046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:51.044318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] PATH_INFO: `/v3/roles/ace62a47cba3428196ca1286882b1fae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:51.045794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] RBAC: Authorizing `identity:get_role(role_id=ace62a47cba3428196ca1286882b1fae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:51.047137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:51.048443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 565/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:50 2022] GET /identity/v3/roles/ace62a47cba3428196ca1286882b1fae => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:51.054468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:51.145487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770f204-8531-4842-8134-dd468f66dc8a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:51.176814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:51.177687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:51.177968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:51.178235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] PATH_INFO: `/v3/users/6d08b284ff94402393e1934b991ffd71` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:51.179398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] RBAC: Authorizing `identity:get_user(user_id=6d08b284ff94402393e1934b991ffd71)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:51.180814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:51.182411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 562/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:46:51 2022] GET /identity/v3/users/6d08b284ff94402393e1934b991ffd71 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:51.187986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:51.280481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee05014-01da-4f0b-90ed-27f58291011a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:51.312150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:51.312770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:51.313049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:51.313323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:51.376872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:51.378982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:51.471495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 566/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:46:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:46:51.478077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:51.570073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5ba8-6493-4bcb-b85d-22a3ad38bd8f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:51.602222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:51.603052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:51.603330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:51.603608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] PATH_INFO: `/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:51.604762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad5b814ae1f4fc29ce2718586ec8784)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:51.606217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1309e7-fa83-4793-8faf-c20b85e90297 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:51.607852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 563/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:46:51 2022] GET /identity/v3/projects/5ad5b814ae1f4fc29ce2718586ec8784 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:51.614315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:51.706077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e119f-c7ca-4b15-b85d-f1e4d8082f5b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:51.738287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:51.738873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:51.739152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:51.739425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:51.740235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] RBAC: Adding query filter params (role.id=ace62a47cba3428196ca1286882b1fae, scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784, user.id=6d08b284ff94402393e1934b991ffd71) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:46:51.740543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:51.741984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4fae-97c8-4c68-9261-20ece8ab446f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:51.747437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 567/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:46:51 2022] GET /identity/v3/role_assignments?user.id=6d08b284ff94402393e1934b991ffd71&scope.project.id=5ad5b814ae1f4fc29ce2718586ec8784&role.id=ace62a47cba3428196ca1286882b1fae => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:46:54.055174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf05cf-c304-4b76-b305-acf1d56fbf9c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:54.055725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf05cf-c304-4b76-b305-acf1d56fbf9c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:54.055725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf05cf-c304-4b76-b305-acf1d56fbf9c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:54.057538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 564/1131] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:54.062544 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:54.062907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:54.063087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:54.080121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:54.081298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:54.142489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 568/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:54.164976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf05cf-c304-4b76-b305-acf1d56fbf9c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:54.260049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf05cf-c304-4b76-b305-acf1d56fbf9c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:54.291082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:54.291846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:54.292125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:54.292398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:54.293584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:54.295014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97ee36-dc34-4c0a-b148-1e6fae752960 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:54.296600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 565/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:54.302663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:54.394412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664ece0-eb96-449f-9efc-01babb4e9571 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:54.426864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:54.427528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:54.427812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:54.428087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:54.428783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:54.430237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b09123-4794-4c47-876f-0ccc0d1d26ef None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:54.498256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 569/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:46:54 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:46:56.818837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9384-18a5-4307-a397-60e3be96f9f8 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:56.819393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9384-18a5-4307-a397-60e3be96f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:56.819393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9384-18a5-4307-a397-60e3be96f9f8 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:56.821291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 566/1135] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:56.826532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:56.826913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:56.827097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:56.844003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:56.845169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:56.907241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 570/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:56.931081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9384-18a5-4307-a397-60e3be96f9f8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:57.026294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9384-18a5-4307-a397-60e3be96f9f8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:57.057531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:57.058297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:57.058576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:57.058848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:57.060001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:57.061422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ad17-1970-403e-971d-5a66da9c96ac None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:57.063022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 567/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:46:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:46:57.069394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:57.160712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46e63-1e05-40d2-95d0-abadd5574cf7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:57.192541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:57.193468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:57.193742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:57.194011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:57.194704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:46:57.196116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b44-751a-4add-ac7b-046f3755d088 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:46:57.291089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 571/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:46:57 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:46:59.637183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f9cd-29e5-41b7-bd62-467c17a47d77 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:59.637710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f9cd-29e5-41b7-bd62-467c17a47d77 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:59.637710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f9cd-29e5-41b7-bd62-467c17a47d77 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:59.639446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 568/1139] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:46:59.645105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:59.645516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:59.645681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:59.663208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:46:59.664365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:46:59.725642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 572/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:46:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:46:59.748341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482f9cd-29e5-41b7-bd62-467c17a47d77 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:59.843870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482f9cd-29e5-41b7-bd62-467c17a47d77 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:46:59.874779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:46:59.875539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:46:59.875820 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:46:59.876094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:46:59.886140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:46:59.893605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:46:59.894693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 569/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:46:59.900482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:46:59.990067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a37d-a22f-45c6-9dca-18739d2e0263 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:00.021654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:00.022294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:00.022568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:00.022835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:00.023558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:00.023856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:00.025196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:00.032675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 573/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:00.038101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:00.131300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808a67f-9177-4929-9d55-5047a18c28e8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:00.161928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:00.162720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:00.163001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:00.163278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] PATH_INFO: `/v3/users/7529b006adba448d926edb20747902e6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:00.176123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] RBAC: Authorizing `identity:get_user(user_id=7529b006adba448d926edb20747902e6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:00.177577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:00.179150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 570/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:00 2022] GET /identity/v3/users/7529b006adba448d926edb20747902e6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:00.184628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:00.277676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5abaa-d4df-436f-b1e2-7e8df911f441 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:00.308831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:00.309480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:00.309762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:00.310035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:00.372266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:00.373749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:00.464181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 574/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:47:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:47:00.469962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:00.564023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218bbc-9875-4a9a-b7b7-e0b9a99efaa9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:00.595368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:00.596719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:00.597040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:00.597318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] PATH_INFO: `/v3/projects/3ef5e86b020e4d17b3ae1864036cf456` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:00.598572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=3ef5e86b020e4d17b3ae1864036cf456)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:00.599996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e85e4d-9d20-44e7-b2f1-8e0d45275ec7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:00.601698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 571/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:00 2022] GET /identity/v3/projects/3ef5e86b020e4d17b3ae1864036cf456 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:00.607624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:00.698913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a1b2f-094c-4172-97df-8190a7d7765f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:00.730398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:00.731030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:00.731309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:00.731580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:00.732392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=3ef5e86b020e4d17b3ae1864036cf456, user.id=7529b006adba448d926edb20747902e6) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:00.732696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:00.734140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e35b94-c912-4c1d-9f1a-b8bf716b13c1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:00.739840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 575/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:47:00 2022] GET /identity/v3/role_assignments?user.id=7529b006adba448d926edb20747902e6&scope.project.id=3ef5e86b020e4d17b3ae1864036cf456&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:03.023189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9e91-c137-43f9-a957-c38fb63e34f6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.023709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9e91-c137-43f9-a957-c38fb63e34f6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.023709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9e91-c137-43f9-a957-c38fb63e34f6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.025513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 572/1147] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:47:03.030607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.031035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.031158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.047369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:03.049036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:03.111713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 576/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:03.134485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9e91-c137-43f9-a957-c38fb63e34f6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:03.229582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b9e91-c137-43f9-a957-c38fb63e34f6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:03.261528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:03.262288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.262564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.262832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.272325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:47:03.279063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:47:03.280145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 573/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:03.286192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:03.382897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7cb1-2345-4e06-b346-82515c61ff9f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:03.415785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:03.416440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.416722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.416996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.417766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:03.418070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:03.419428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:03.427699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 577/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:47:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:03.433684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:03.526459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9e76-b0e0-4927-a5f6-5b84ce2f5d7f None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:03.558440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:03.559231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.559509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.559777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] PATH_INFO: `/v3/users/7529b006adba448d926edb20747902e6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.560933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7529b006adba448d926edb20747902e6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:03.562388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:03.563948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 574/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:03 2022] GET /identity/v3/users/7529b006adba448d926edb20747902e6 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:03.569775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:03.660967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287347-4b3a-419e-ba2e-1a88c3a95e81 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:03.691852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:03.692946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.693223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.693519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] PATH_INFO: `/v3/projects/3ef5e86b020e4d17b3ae1864036cf456` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.694667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] RBAC: Authorizing `identity:get_project(project_id=3ef5e86b020e4d17b3ae1864036cf456)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:03.696070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6aa2-2b1b-4dc7-9a4b-06cfda881005 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:03.697741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 578/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:03 2022] GET /identity/v3/projects/3ef5e86b020e4d17b3ae1864036cf456 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:03.703683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:03.796535 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213b94-6ebd-4f95-9313-2d8c8279b3b4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:03.828159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:03.828961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:03.829239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:03.830041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] PATH_INFO: `/v3/projects/3ef5e86b020e4d17b3ae1864036cf456/users/7529b006adba448d926edb20747902e6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:03.831962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ef5e86b020e4d17b3ae1864036cf456, user_id=7529b006adba448d926edb20747902e6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:03.833381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e446646-f651-43d1-8b5c-54e067cbf2c7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:03.930467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 575/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:47:03 2022] PUT /identity/v3/projects/3ef5e86b020e4d17b3ae1864036cf456/users/7529b006adba448d926edb20747902e6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:47:06.230809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1ce1-6ea7-4375-aea5-a685f7611307 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.231352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1ce1-6ea7-4375-aea5-a685f7611307 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.231352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1ce1-6ea7-4375-aea5-a685f7611307 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.233104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 579/1154] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:06.238270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.238656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.238831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.255277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:06.256449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:06.319161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 576/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:06.342830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d1ce1-6ea7-4375-aea5-a685f7611307 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:06.438240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d1ce1-6ea7-4375-aea5-a685f7611307 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:06.470698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:06.471468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.471750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.472024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.482975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:47:06.489739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:47:06.490902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 580/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:06.497223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:06.588891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39f00-b5bb-46a3-a40a-ab931eb69a24 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:06.619666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:06.620302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.620578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.620848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.621614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:06.621917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:06.623277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:06.631276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 577/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:06.636878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:06.730036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82adc08-3ba6-4592-ac32-aae113b138e9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:06.761355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:06.762329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.762610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.762881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] PATH_INFO: `/v3/users/7529b006adba448d926edb20747902e6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.764039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] RBAC: Authorizing `identity:get_user(user_id=7529b006adba448d926edb20747902e6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:06.765482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:06.767713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 581/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:06 2022] GET /identity/v3/users/7529b006adba448d926edb20747902e6 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:06.773558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:06.865423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff7633-bacb-43f8-87fc-c5abe7c40e54 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:06.896370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:06.896987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:06.897265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:06.897571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:06.959947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:06.961389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:07.051338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 578/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:47:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:47:07.056956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:07.150199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d76f9a-9ebb-47cb-bfe7-f3d05341ee73 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:07.181378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:07.182231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:07.182514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:07.182779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] PATH_INFO: `/v3/projects/3ef5e86b020e4d17b3ae1864036cf456` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:07.183947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] RBAC: Authorizing `identity:get_project(project_id=3ef5e86b020e4d17b3ae1864036cf456)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:07.185359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8180-7fee-4db7-ac6b-816fe39f1b81 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:07.187020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 582/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:07 2022] GET /identity/v3/projects/3ef5e86b020e4d17b3ae1864036cf456 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:07.193644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:07.284502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08ff4c-db89-4381-82d3-f594d4a10f61 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:07.316158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:07.316743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:07.317277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:07.317588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:07.318435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=3ef5e86b020e4d17b3ae1864036cf456, user.id=7529b006adba448d926edb20747902e6) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:07.318743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:07.320162 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f1b43-b66c-4bb9-9c7e-cd471ee2321b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:07.325677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 579/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:47:07 2022] GET /identity/v3/role_assignments?user.id=7529b006adba448d926edb20747902e6&scope.project.id=3ef5e86b020e4d17b3ae1864036cf456&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:09.634131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891118-4d9d-440a-97a4-1489f26d483f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:09.634627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891118-4d9d-440a-97a4-1489f26d483f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:09.634627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891118-4d9d-440a-97a4-1489f26d483f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:09.636385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 583/1162] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:09.642205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:09.642630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:09.642762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:09.659040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:09.660199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:09.722122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 580/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:09.744343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891118-4d9d-440a-97a4-1489f26d483f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:09.841080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891118-4d9d-440a-97a4-1489f26d483f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:09.871945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:09.872562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:09.872838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:09.873109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:09.934121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:09.935489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:10.025035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 584/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:47:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:47:10.030826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:10.121956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e6ccd-5273-4175-9076-6b1f4a93d4d4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:10.153330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:10.154249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:10.154537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:10.154808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:10.161731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:10.163158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:10.176000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e2a0e9c1-f959-4fa0-b17c-76e83dd240c9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 05:47:10.177116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 581/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:47:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:10.182778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:10.275095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765875e-e6c8-4ae6-9a74-c92a8c748c3f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:10.305797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:10.306426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:10.306727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:10.306997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:10.307695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:10.307995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:10.309332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0613-c3d4-4bde-a982-a97317004465 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:10.316524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 585/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Aug 23 05:47:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:12.614139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d93ac-5b04-48ad-9056-396bdecd681c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:12.614679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d93ac-5b04-48ad-9056-396bdecd681c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:12.614679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d93ac-5b04-48ad-9056-396bdecd681c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:12.616450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 582/1167] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:12.621699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c425-770e-4ed7-8096-7ae84f06047c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:12.622114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c425-770e-4ed7-8096-7ae84f06047c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:12.622251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283c425-770e-4ed7-8096-7ae84f06047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:12.639011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e283c425-770e-4ed7-8096-7ae84f06047c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:12.640114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e283c425-770e-4ed7-8096-7ae84f06047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:12.703076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 586/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:12.726372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d93ac-5b04-48ad-9056-396bdecd681c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:12.822697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d93ac-5b04-48ad-9056-396bdecd681c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:12.853066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:12.853731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:12.854080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:12.854355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:12.855080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:12.856645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bafe5-8b91-4b78-af33-9c733eaaa888 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:12.948810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 583/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Tue Aug 23 05:47:12 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:47:15.253688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731ce2-c42a-45fd-8f39-1a0fe6f8085f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:15.254238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731ce2-c42a-45fd-8f39-1a0fe6f8085f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:15.254238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731ce2-c42a-45fd-8f39-1a0fe6f8085f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:15.256004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 587/1170] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:15.261042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:15.261466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:15.261633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:15.278540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:15.279688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:15.343234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 584/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:15.366616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42731ce2-c42a-45fd-8f39-1a0fe6f8085f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:15.463204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42731ce2-c42a-45fd-8f39-1a0fe6f8085f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:15.494135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:15.494977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:15.495256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:15.495531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] PATH_INFO: `/v3/domains/9cab64277de6431489147c8465027fb0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:15.505921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9cab64277de6431489147c8465027fb0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:15.507300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ea2ba-9e16-4709-8353-673e05f840b4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:15.508890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 588/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Aug 23 05:47:15 2022] GET /identity/v3/domains/9cab64277de6431489147c8465027fb0 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:15.514681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:15.729821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8fcfd-5323-4ea3-ae5f-2e6df5e30d0a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:15.760665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:15.761238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:15.761540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:15.761812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:15.762511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:15.763901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b912cf-c150-400a-a610-8381f9cc6c6f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:15.865221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 585/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:47:15 2022] POST /identity/v3/projects => generated 361 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 05:47:18.210889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a938be-2ce2-42e7-8025-0051cd71d319 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:18.211412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a938be-2ce2-42e7-8025-0051cd71d319 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:18.211412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a938be-2ce2-42e7-8025-0051cd71d319 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:18.213195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 589/1174] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:18.218412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:18.218785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:18.218965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:18.235832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:18.236988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:18.297250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 586/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:18.321963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a938be-2ce2-42e7-8025-0051cd71d319 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:18.418966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a938be-2ce2-42e7-8025-0051cd71d319 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:18.450334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:18.451169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:18.451449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:18.451723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] PATH_INFO: `/v3/domains/9cab64277de6431489147c8465027fb0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:18.452872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=9cab64277de6431489147c8465027fb0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:18.454326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82f8b-bc76-4d67-a4f8-b0aff13fa60a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:18.455894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 590/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Aug 23 05:47:18 2022] GET /identity/v3/domains/9cab64277de6431489147c8465027fb0 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:18.462316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:18.552450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207cd7-9f1d-4069-a84a-d80b6307ec80 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:18.584026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:18.584666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:18.584944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:18.585213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:18.585932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:18.587352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42747-b78c-46ac-8849-3d4d4f4441fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:18.653049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 587/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:47:18 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:47:20.985399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8237-80a6-4df0-b22b-d6c1a8ae2aa5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:20.985994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8237-80a6-4df0-b22b-d6c1a8ae2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:20.985994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8237-80a6-4df0-b22b-d6c1a8ae2aa5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:20.987746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 591/1178] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:20.992841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:20.993209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:20.993394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.010187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:21.011346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:21.074240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 588/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:21.096994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8237-80a6-4df0-b22b-d6c1a8ae2aa5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:21.193255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8237-80a6-4df0-b22b-d6c1a8ae2aa5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:21.224162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:21.224921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:21.225201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:21.225493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.235374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:47:21.242692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:47:21.243771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 592/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:21.249743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:21.341665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69571-f15b-4515-9262-09211b8837ba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:21.373527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:21.374216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:21.374489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:21.374758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.375527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:21.375827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:21.377227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:21.385770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 589/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:21.391424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:21.484273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e406d-cc4f-472d-8de2-8d7cc98b849b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:21.515643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:21.516472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:21.516744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:21.517014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] PATH_INFO: `/v3/users/00297927d755495ea220b2f38c3d615e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.529207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] RBAC: Authorizing `identity:get_user(user_id=00297927d755495ea220b2f38c3d615e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:21.530653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:21.532230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 593/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/users/00297927d755495ea220b2f38c3d615e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:21.538265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:21.631762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f630-288d-478d-9848-febda1c75a59 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:21.662661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:21.663280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:21.663554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:21.663824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.725444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:21.726886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:21.816751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 590/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:47:21.822689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:21.914685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee4df-ff13-4708-bae3-63fb52471342 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:21.945989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:21.946827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:21.947359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:21.947630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] PATH_INFO: `/v3/projects/e5aba23b5d0445348a100666f752172d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:21.948777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] RBAC: Authorizing `identity:get_project(project_id=e5aba23b5d0445348a100666f752172d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:21.950216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd37b-c040-41aa-83dc-15dcf1915564 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:21.951866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 594/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/projects/e5aba23b5d0445348a100666f752172d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:21.957781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:22.049187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0102-93ac-471f-a1d9-5bb961c7c09a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:22.080527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:22.081099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:22.081379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:22.081680 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:22.082497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=e5aba23b5d0445348a100666f752172d, user.id=00297927d755495ea220b2f38c3d615e) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:22.082802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:22.084734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcd97b-6185-4293-936d-112a828e95fa None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:22.089845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 591/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:47:21 2022] GET /identity/v3/role_assignments?user.id=00297927d755495ea220b2f38c3d615e&scope.project.id=e5aba23b5d0445348a100666f752172d&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:24.362180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f3cd-3884-4151-8b2b-ab0db376a16f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:24.362700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f3cd-3884-4151-8b2b-ab0db376a16f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:24.362700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f3cd-3884-4151-8b2b-ab0db376a16f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:24.364491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 595/1186] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:24.369771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:24.370178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:24.370313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:24.386965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:24.388131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:24.450224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 592/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:24.473094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083f3cd-3884-4151-8b2b-ab0db376a16f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:24.565513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083f3cd-3884-4151-8b2b-ab0db376a16f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:24.597426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:24.598212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:24.598488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:24.598757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:24.608180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:47:24.615005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:47:24.616105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 596/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:24.622016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:24.715927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e31d5-ab98-44b1-b97c-d9d730e684ab None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:24.746335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:24.746971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:24.747247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:24.747515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:24.748249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:24.748548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:24.749933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:24.757901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 593/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:47:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:24.763477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:24.856966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2403c-9321-40dd-99a1-9b1202fa1a94 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:24.888959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:24.889771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:24.890052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:24.890327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] PATH_INFO: `/v3/users/00297927d755495ea220b2f38c3d615e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:24.891506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] RBAC: Authorizing `identity:get_user(user_id=00297927d755495ea220b2f38c3d615e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:24.892931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:24.894546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 597/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:24 2022] GET /identity/v3/users/00297927d755495ea220b2f38c3d615e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:24.899998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:24.993715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e03fd-8544-45d6-88e6-3bbb08296c80 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:25.024446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:25.025274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:25.025588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:25.025858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] PATH_INFO: `/v3/projects/e5aba23b5d0445348a100666f752172d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:25.027001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] RBAC: Authorizing `identity:get_project(project_id=e5aba23b5d0445348a100666f752172d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:25.028412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bde5d-4798-4e60-9a65-9456ad6d097a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:25.030073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 594/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:24 2022] GET /identity/v3/projects/e5aba23b5d0445348a100666f752172d => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:25.035847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:25.128740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2b001-09ce-4160-af78-174756bbae65 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:25.160135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:25.160943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:25.161225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:25.161529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] PATH_INFO: `/v3/projects/e5aba23b5d0445348a100666f752172d/users/00297927d755495ea220b2f38c3d615e/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:25.163989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] RBAC: Authorizing `identity:create_grant(project_id=e5aba23b5d0445348a100666f752172d, user_id=00297927d755495ea220b2f38c3d615e, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:25.165415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924494-0b6a-41a0-8623-f37dafa9ed1e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:25.238391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 598/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:47:25 2022] PUT /identity/v3/projects/e5aba23b5d0445348a100666f752172d/users/00297927d755495ea220b2f38c3d615e/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:47:27.521278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dcd7-8655-479d-8bca-b6cb33abfb19 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:27.521827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dcd7-8655-479d-8bca-b6cb33abfb19 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:27.521918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dcd7-8655-479d-8bca-b6cb33abfb19 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:27.523662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 595/1193] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:47:27.528802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:27.529162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:27.529342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:27.546108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:47:27.547266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:47:27.608880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 599/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:47:27.632050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dcd7-8655-479d-8bca-b6cb33abfb19 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:27.728710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dcd7-8655-479d-8bca-b6cb33abfb19 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:27.759437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:27.760197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:27.760473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:27.760744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:27.770565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:47:27.777203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:47:27.778364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 596/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:47:27.784321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:27.876263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a24c5-268f-4c5d-b057-bdeff3275eaf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:27.907413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:27.908004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:27.908283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:27.908553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:27.909272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:27.909597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:27.910941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:27.919080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 600/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:27.924675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:28.015775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84044fae-3f72-480a-aab9-29b98682e7ae None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:28.047330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:28.048171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:28.048444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:28.048707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] PATH_INFO: `/v3/users/00297927d755495ea220b2f38c3d615e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:28.049889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] RBAC: Authorizing `identity:get_user(user_id=00297927d755495ea220b2f38c3d615e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:28.051303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:28.052866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 597/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Aug 23 05:47:27 2022] GET /identity/v3/users/00297927d755495ea220b2f38c3d615e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:28.058690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:28.151963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801b3ca-b466-49d2-bf91-e11efdd71d4f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:28.183310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:28.183881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:28.184160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:28.184433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:28.246712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:28.248135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:28.339107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 601/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:47:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:47:28.344726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:28.443754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50d2c-391c-4d45-b5da-49e4967f73e9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:28.475381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:28.476219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:28.477040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:28.477314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] PATH_INFO: `/v3/projects/e5aba23b5d0445348a100666f752172d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:28.478511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=e5aba23b5d0445348a100666f752172d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:28.479935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e0b9-0e44-4965-a070-60bc9bdb9ab9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:28.481606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 598/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Aug 23 05:47:28 2022] GET /identity/v3/projects/e5aba23b5d0445348a100666f752172d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:47:28.487781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:47:28.580264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f75e-4d6b-40f2-833d-1caa0520e4f6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:47:28.612268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:47:28.612895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:47:28.613175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:47:28.613474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:47:28.614284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=e5aba23b5d0445348a100666f752172d, user.id=00297927d755495ea220b2f38c3d615e) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:47:28.614591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:47:28.616003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaeb80-a004-4392-a951-52d2359fce22 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:47:28.621447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 602/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:47:28 2022] GET /identity/v3/role_assignments?user.id=00297927d755495ea220b2f38c3d615e&scope.project.id=e5aba23b5d0445348a100666f752172d&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:47.173539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b709-ced8-438c-ab9c-a179b3582f08 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:47.174127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b709-ced8-438c-ab9c-a179b3582f08 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:47.174127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230b709-ced8-438c-ab9c-a179b3582f08 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:47.175846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 599/1201] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:48:47.181559 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:47.181946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:47.182150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:47.199119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:48:47.200276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:48:47.264088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 603/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:48:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:48:47.287875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230b709-ced8-438c-ab9c-a179b3582f08 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:47.384887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230b709-ced8-438c-ab9c-a179b3582f08 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:47.416567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:47.417337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:47.417651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:47.417923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:47.428287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:47.429750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:47.446063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:47.447202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 600/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:47.453262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:47.547083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b2f64-f228-44e3-a179-b18a75d9b453 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:47.579550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:47.580198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:47.580479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:47.580754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:47.581480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:47.581785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:47.583161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e365-b364-48b5-a072-1f5e089fbc22 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:47.594106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 604/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:47.600800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:47.697686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85d1e-ddae-423e-8d5c-c369b10778b3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:47.730370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:47.731051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:47.738543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:47.738543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:47.738543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:47.738543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b24a-dc0d-4299-9ca6-6f170c3e1c9a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:47.806348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 601/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Aug 23 05:48:47 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:48:50.146463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2710-0737-4fdf-a185-96db7a9d779a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.147530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2710-0737-4fdf-a185-96db7a9d779a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.147635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2710-0737-4fdf-a185-96db7a9d779a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.149396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 605/1206] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:48:50.154745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.155261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.155367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.173209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:48:50.174411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:48:50.236749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 602/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:48:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:48:50.261050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2710-0737-4fdf-a185-96db7a9d779a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:50.359801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2710-0737-4fdf-a185-96db7a9d779a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:50.391829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:50.392623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.392901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.393173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.405761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:48:50.410883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:48:50.412083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 606/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:48:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:50.418843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:50.511970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57580d-8c2c-45ff-b458-1ae5752ec44f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:50.543980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:50.544620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.544899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.545171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.545944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:50.546302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:50.547670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:50.555159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 603/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:48:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:50.560824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:50.654363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a772-5838-44f0-b343-15101863ad62 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:50.686519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:50.687231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.687510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.687780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.697773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:50.699201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:50.715623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:50.716762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 607/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:50.722615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:50.815828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a5d6-a217-4695-85ca-460e5ed24367 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:50.847835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:50.848470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.848749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.849017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:50.849751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:50.850067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:50.851749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:50.862686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 604/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:50.868888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:50.963266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595dedb-2fef-4b9b-98b6-8d6a276b9db3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:50.995940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:50.996717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:50.996996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:50.997269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.004283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.005741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.019854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:48:51.021004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 608/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:51.026848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:51.121178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd423e-a36c-4e13-b7c7-29b0336237e8 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:51.152930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:51.153609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:51.153943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:51.154265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.155086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:51.155651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.156796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.172948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 605/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:51.179116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:51.272249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af65af-feb0-47dc-893d-7b2d27ee9ce6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:51.304355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:51.305022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:51.305302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:51.305603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.370228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.371677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.463841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 609/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:48:51.469770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:51.562851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb054dc9-b039-43b4-9234-95907ff93073 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:51.594486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:51.595260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:51.595538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:51.595806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.605915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.607352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.624851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:51.626027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 606/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:51.631918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:51.727846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63c99-9802-4403-b21b-442a938de3fa None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:51.761922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:51.762580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:51.762861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:51.763136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.763846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:51.764264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.765740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.777190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 610/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:51.782886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:51.876778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63c85-6d8a-4f02-9010-779461834d58 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:51.909380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:51.910401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:51.910692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:51.910950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:51.917661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:51.919108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:51.932408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:48:51.933594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 607/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:51.939555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:52.033692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c995012-a487-451e-a89f-8788e8223a74 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:52.066311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:52.066951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:52.069109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:52.069109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:52.069109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:52.069109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:52.070001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35e0a-55b4-4bec-beff-8f0b73eb2e86 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:52.082072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 611/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:52.088121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:52.184218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a5d0d-0b0c-43e8-bfd5-6b2b3f18dbc7 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:52.215615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:52.216252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:52.223912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:52.223912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:52.223912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=655db89983b446278bc27381688d2f4d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:52.223912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:52.223912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4227-41c2-4216-a47c-c734c57bb912 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:52.224751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 608/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:48:52 2022] GET /identity/v3/role_assignments?user.id=655db89983b446278bc27381688d2f4d&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:54.481996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a24-385c-4c30-902a-941c72f2a398 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:54.482605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a24-385c-4c30-902a-941c72f2a398 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:54.482605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a24-385c-4c30-902a-941c72f2a398 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:54.484307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 612/1220] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:48:54.489338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:54.489803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:54.489934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:54.506722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:48:54.508431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:48:54.570338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 609/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:48:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:48:54.592994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea1a24-385c-4c30-902a-941c72f2a398 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:54.688848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea1a24-385c-4c30-902a-941c72f2a398 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:54.720152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:54.720953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:54.721229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:54.721518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:54.731604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:48:54.738508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:48:54.739709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 613/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:48:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:54.746360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:54.839572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a353-6b04-4bba-9519-f7ab0bedcdaf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:54.872106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:54.872767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:54.873042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:54.873316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:54.874093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:54.874406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:54.875809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:54.884037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 610/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:48:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:54.889875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:54.986835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37505b-b76f-4954-815d-8d2993a72fef None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.019097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.019867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.020149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.020423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.030533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.031965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.048213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:55.049345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 614/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:55.055800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.150671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b85f4-389f-4dc4-8d99-1e2f672c04f3 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.183351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.184004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.184285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.184560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.185292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:55.185620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.186996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.198320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 611/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:55.204131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.298534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798fae4-7c6a-4c08-b75e-64c5db44bc58 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.330540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.333273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.333273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.333273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.339738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.341159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.355153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:48:55.356673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 615/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:55.362422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.457055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bec55-4d24-48d2-9da5-5450dfac9b02 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.489234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.489914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.490416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.490514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.491263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:55.491596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.493018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.509053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 612/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:55.516078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.610991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3cf02-c6e6-4cff-91fa-59a49a831c51 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.641624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.642392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.642674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.642953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.653303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.654764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.670880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:55.672016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 616/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:55.677615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.769585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a335-9975-44ad-bd11-20b453423de4 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.800938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.801602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.801881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.802153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.802864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:55.803165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.804556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.815295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 613/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:55.821354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:55.917596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ec8a-c9b5-4d96-95f6-a3e36adf9583 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:55.948942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:55.949743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:55.950026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:55.950299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:55.956643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:55.958111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:55.971665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:48:55.972799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 617/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:55.978889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:56.072306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c329a-29af-4cf4-b723-c496dbae6d6e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:56.104416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:56.110331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7749f3-f5ca-427c-9980-91b72d3bb6fd None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:56.120029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 614/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:56.126020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:56.219894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cacbc-a7ad-4f46-80b0-7a808b5669e9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:56.251915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:56.252802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:56.253076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:56.253345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/655db89983b446278bc27381688d2f4d/roles/e9a649d1d05249419a16e1ee57901ede` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:56.267456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=655db89983b446278bc27381688d2f4d, role_id=e9a649d1d05249419a16e1ee57901ede)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:56.270274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a548cf-1508-44cb-b6c4-1ff4c2e3f6ab None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:56.368491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 618/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:48:56 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/655db89983b446278bc27381688d2f4d/roles/e9a649d1d05249419a16e1ee57901ede => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:48:58.684018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877547-ad22-422b-8696-138836a9c1fc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:58.684515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877547-ad22-422b-8696-138836a9c1fc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:58.684515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877547-ad22-422b-8696-138836a9c1fc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:58.686319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 615/1233] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:48:58.691342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:58.691761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:58.691928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:58.707952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:48:58.709140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:48:58.774571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 619/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:48:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:48:58.797768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877547-ad22-422b-8696-138836a9c1fc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:58.892514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877547-ad22-422b-8696-138836a9c1fc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:58.923817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:58.924580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:58.924857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:58.925125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:58.934649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:48:58.941518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 05:48:58.942654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 616/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Aug 23 05:48:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:58.949196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.043662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3239bb2-04c8-42b3-a553-5e47ee4e8bd9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.078219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.078878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.079158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.079429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.080169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:59.080469 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.081862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:59.090477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 620/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Aug 23 05:48:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:59.096328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.192387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d7100-26f9-4080-8afa-9b652b70a914 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.225165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.225969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.226257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.226558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.237902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.239407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:59.256056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:48:59.257195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 617/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:59.263812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.358414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038cd-c77d-41af-bfbc-248ce54f0760 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.391975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.392629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.392910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.393184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.393932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:59.394261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.395644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:59.406703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 621/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:59.412398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.507037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c1780-53cb-43c4-9414-49cea9497881 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.538298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.539587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.539865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.540135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.547352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.548778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:59.562397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:48:59.563544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 618/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:48:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:48:59.569386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.665265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5a7e-2eb8-4487-8905-165cb4a73614 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.696891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.697570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.697850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.698123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.698935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:48:59.699238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.700643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:48:59.717050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 622/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:48:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:48:59.722772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:48:59.816646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756627b6-75e0-4ed6-bb21-3a6791b5546e None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:48:59.848659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:48:59.849295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:48:59.849604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:48:59.852356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:48:59.915255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:48:59.916733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.007750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 619/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:48:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:49:00.013450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:00.117510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1a9c-9062-4899-a3c4-2f15c8ac108e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:00.149380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:00.150203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:00.150478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:00.150746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:00.160212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:00.161667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.178577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:00.181149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 623/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:00.185585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:00.278455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23db4c-cca6-4016-8470-9bd0a1c5f913 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:00.309594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:00.310261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:00.310517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:00.310789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:00.311495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:00.311794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:00.313151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.324332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 620/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:00.330015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:00.424585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244732-04d1-4384-8506-1334f849e2e2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:00.456219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:00.456984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:00.457259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:00.457558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:00.464564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:00.466014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.479061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:49:00.480247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 624/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:00.486141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:00.580230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127717a6-173c-456e-8f2a-9bb43dfc5d49 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:00.611457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:00.612113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:00.612366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:00.612633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:00.613405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:00.613735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:00.615148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79992fd-4fd4-4253-a701-3386c6421f0c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.626874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 621/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:00.633530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:00.727978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae257a-eefe-46c4-92ec-de01b4d17d03 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:00.760173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:00.760835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:00.761122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:00.761396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:00.762255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] RBAC: Adding query filter params (role.id=e9a649d1d05249419a16e1ee57901ede, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=655db89983b446278bc27381688d2f4d) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:00.766968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:00.766968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416631-1e66-4ed2-a03b-bb1a4e479958 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:00.769593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 625/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:49:00 2022] GET /identity/v3/role_assignments?user.id=655db89983b446278bc27381688d2f4d&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=e9a649d1d05249419a16e1ee57901ede => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:03.122745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7178-5b60-472c-9634-fd37853bb6fc None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.123293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7178-5b60-472c-9634-fd37853bb6fc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.123293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7178-5b60-472c-9634-fd37853bb6fc None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.125068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 622/1247] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:03.130316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.133324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.133324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.147257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:03.148431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:03.213689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 626/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:03.237384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a7178-5b60-472c-9634-fd37853bb6fc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:03.334618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a7178-5b60-472c-9634-fd37853bb6fc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:03.367836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:03.368624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.368902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.371061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.379401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:49:03.386929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:49:03.388108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 623/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:03.394020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:03.488065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6211c-00bd-4cd1-bd2a-f7041e830069 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:03.519872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:03.520524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.520801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.521070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.521826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:03.522126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:03.523472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:03.531628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 627/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:03.537471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:03.631806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a32-d763-4110-93fa-45e4843f04ef None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:03.663302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:03.664067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.664352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.664690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.674693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:03.676133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:03.692450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:03.694440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 624/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:03.700021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:03.793331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04e4d-7fc7-4223-97e0-791436514147 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:03.826008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:03.826660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.826941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.827242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.827953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:03.828253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:03.829661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:03.840874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 628/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:03.846549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:03.940069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452a3a-0735-4c4f-a967-a38ad188208c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:03.971594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:03.972371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:03.972647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:03.972915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:03.980793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:03.982257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:03.995843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:49:03.996969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 625/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:04.002743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:04.096473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd33c37-f87d-4d14-bafa-dd6f9174642f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:04.131151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:04.131799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:04.132078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:04.132349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:04.133161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:04.133516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:04.134924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:04.152074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 629/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:04.157906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:04.251951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22f64-1031-42a0-a7f6-4bafad3f9e70 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:04.287975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:04.288613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:04.288895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:04.289169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:04.353705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:04.355153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:04.447699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 626/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:49:04.453731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:04.548820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7acb6-53f0-451e-b5e4-089e12db3912 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:04.581116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:04.581923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:04.582231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:04.582504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:04.592652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:04.594128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:04.611474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:04.612637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 630/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:04.618455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:04.711124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ef197-6758-48ba-93e0-7d10430675d2 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:04.743539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:04.744174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:04.744449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:04.744720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:04.745422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:04.745751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:04.747130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:04.757552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 627/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:04.763836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:04.858797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc80234-f65d-4c8f-bf50-d92574ad4949 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:04.892236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:04.893011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:04.893287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:04.893590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:04.900529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:04.902028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:04.914580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:49:04.915757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 631/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:04.921615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:05.014600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f644c-349c-40cb-aa05-4714b0e8439d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:05.045899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:05.046538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:05.046816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:05.047117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:05.047892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:05.048251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:05.049651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1e00-e8c8-4226-b907-cb9b27aa0821 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:05.060940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 628/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:05.067023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:05.161022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc817b3-dce2-474e-90a2-976a9c591814 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:05.192493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:05.193161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:05.193467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:05.193755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:05.194580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=655db89983b446278bc27381688d2f4d) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:05.194892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:05.196923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d68d8-5b63-43d3-9e94-335c6110c6c9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:05.202172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 632/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:49:05 2022] GET /identity/v3/role_assignments?user.id=655db89983b446278bc27381688d2f4d&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:07.527673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3204f3-d8bb-46c5-a732-35ec8a7dd0f0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:07.528221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3204f3-d8bb-46c5-a732-35ec8a7dd0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:07.528221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3204f3-d8bb-46c5-a732-35ec8a7dd0f0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:07.530046 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 629/1261] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:07.535273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:07.535684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:07.535835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:07.553091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:07.554292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:07.618912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 633/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:07.641313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3204f3-d8bb-46c5-a732-35ec8a7dd0f0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:07.737171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3204f3-d8bb-46c5-a732-35ec8a7dd0f0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:07.768798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:07.769599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:07.769880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:07.770152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:07.780300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:49:07.787151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:49:07.788299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 630/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:07.794518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:07.889563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44ee18-042d-4c95-8336-6979b9294f30 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:07.921499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:07.922125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:07.922407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:07.922686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:07.923417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:07.923726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:07.925078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:07.932691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 634/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:07.938589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.033917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16a6e-6ca7-4dc1-928b-415c9bfd94ce None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.065569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.066356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.066635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.066906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.078329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.079845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.095934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:08.103224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 631/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:08.103676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.198430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3a0d-7a33-4a9f-8c93-3d98c8e0be1f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.231230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.231896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.232185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.232480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.233191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:08.233522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.234893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.246620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 635/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:08.252213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.347302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5021e-f62d-4d86-8829-e6c85390f918 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.379788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.380582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.380860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.381612 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.388886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.390354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.403873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:49:08.414427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 632/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:49:08.414545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.508996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62067a-df74-468d-98f4-caa80bc6a6a4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.542691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.543338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.543624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.543898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.544726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:08.545031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.546499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.563830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 636/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:08.569461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.666207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380921-db5d-43ed-a4cc-33747872f2ea None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.698336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.699114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.699397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.699670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.709967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.711478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.727806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:08.729252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 633/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:08.735084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.829935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd28c-6ea1-4ef0-a046-5a3a2e454971 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:08.863193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:08.863840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:08.864140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:08.864472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:08.865181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:08.865534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:08.866898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:08.878311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 637/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:08.883929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:08.979375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2a33-021a-455f-ac7e-23f4e5b1e53c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:09.012069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023495-9057-49eb-977b-add555715d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:09.012845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023495-9057-49eb-977b-add555715d6a None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:09.013128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023495-9057-49eb-977b-add555715d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:09.013409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023495-9057-49eb-977b-add555715d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:09.020203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023495-9057-49eb-977b-add555715d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:09.021699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023495-9057-49eb-977b-add555715d6a None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:09.034782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-ff023495-9057-49eb-977b-add555715d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:49:09.036200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 634/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:09.042303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:09.137548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7275a-88c3-4cea-b761-f42d13dd122a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:09.168893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:09.169571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:09.169854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:09.170128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:09.170899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:09.171202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:09.172619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077905e-de20-41e0-96ef-16dbb3e58b28 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:09.184833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 638/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:09.190850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023495-9057-49eb-977b-add555715d6a None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:09.286778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023495-9057-49eb-977b-add555715d6a None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:09.320196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:09.321065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:09.321342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:09.321643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] PATH_INFO: `/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/655db89983b446278bc27381688d2f4d/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:09.323689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=8f9654b0cd494e1b93f80ef04892bc23, user_id=655db89983b446278bc27381688d2f4d, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:09.325114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b78a6-5b9a-488f-8b92-4943fbc31d4f None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:09.422322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 635/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Aug 23 05:49:09 2022] PUT /identity/v3/projects/8f9654b0cd494e1b93f80ef04892bc23/users/655db89983b446278bc27381688d2f4d/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 05:49:11.713255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29588-3e49-4831-b64b-1ea2806454b0 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:11.713813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29588-3e49-4831-b64b-1ea2806454b0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:11.713813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29588-3e49-4831-b64b-1ea2806454b0 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:11.715567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 639/1274] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:11.720678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:11.721094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:11.721231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:11.739348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:11.740546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:11.804442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 636/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:11.828334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd29588-3e49-4831-b64b-1ea2806454b0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:11.925685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd29588-3e49-4831-b64b-1ea2806454b0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:11.957164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:11.958131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:11.958407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:11.958678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:11.969228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 05:49:11.976168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 05:49:11.977335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 640/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Aug 23 05:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:11.984348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.077773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529185ab-0afe-4c9b-8f7b-607e4c019234 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.111103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.111755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.112038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.112315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.113060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:12.113363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.114765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:12.122722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 637/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Aug 23 05:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:12.128384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.228100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42cac-2cfe-4084-8b42-115994ec5683 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.259586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.261031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.261314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.261605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.272529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.274006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:12.290720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:12.292067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 641/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 05:49:12.297719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.392928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c7ca-8427-4b62-9c79-38608bc74d60 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.424784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.425459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.425743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.426017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.426821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:12.427123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.428479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:12.439610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 638/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:12.445309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.544261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaccf2-fccb-4ff3-b1e2-3c87c4d518fd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.576295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.577079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.578689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.578689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.584896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.586399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:12.603215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 05:49:12.607386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 642/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:12.611150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.705060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6b9-d9c4-4404-a8d3-a348d9854d8b None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.737986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.738645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.738925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.739199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.740030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:12.740360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.741859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:12.758075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 639/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Aug 23 05:49:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:12.763879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:12.859936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812861c-49a6-4f36-84c2-51b102ad326f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:12.891673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:12.892307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:12.892584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:12.892902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:12.956660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:12.958134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.052526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 643/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Aug 23 05:49:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 05:49:13.059171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:13.153393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a441-822b-4402-acb8-68c0c41e080d None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:13.186179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:13.186954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:13.187236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:13.187510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:13.197079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:13.198720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.216104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 05:49:13.217256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 640/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:13.223195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:13.318302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151338-48f2-4051-92f8-7588e98bfbaf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:13.352560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:13.353733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:13.354017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:13.355211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:13.355947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:13.356250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:13.357642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.369115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 644/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Aug 23 05:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:13.374877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:13.469337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d7059-b7d8-4c23-8fb3-568f5e704c92 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:13.502494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:13.503262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:13.503542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:13.503814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:13.510117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:13.511582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.524253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING keystone.server.flask.application [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 05:49:13.525387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 641/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Aug 23 05:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:13.531841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:13.627671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9744-5ce6-4d7e-9838-90e23c7ef56b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:13.662762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:13.663412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:13.663691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:13.663962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:13.664732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:13.665034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:13.666553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408697c-23bf-419b-8e25-8a4b42d16428 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.678699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 645/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Aug 23 05:49:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 05:49:13.684785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:13.780668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719726fe-0483-44cc-a75c-937decf9601c None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:13.812036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:13.812674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:13.812954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:13.813226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:13.814097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] RBAC: Adding query filter params (role.id=0b140cf23eea4013a92d34840813e9cf, scope.project.id=8f9654b0cd494e1b93f80ef04892bc23, user.id=655db89983b446278bc27381688d2f4d) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:13.814405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:13.815873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ed60-ab12-41f0-858a-ea334936dc7b None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:13.821507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 642/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Aug 23 05:49:13 2022] GET /identity/v3/role_assignments?user.id=655db89983b446278bc27381688d2f4d&scope.project.id=8f9654b0cd494e1b93f80ef04892bc23&role.id=0b140cf23eea4013a92d34840813e9cf => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:16.131779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5967f-c94b-472b-a342-85e1dac86ea9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:16.132316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5967f-c94b-472b-a342-85e1dac86ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:16.132316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5967f-c94b-472b-a342-85e1dac86ea9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:16.134142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 646/1288] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:16.139515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:16.139925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:16.140070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:16.156329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:16.157532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:16.221011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 643/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:16.244062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5967f-c94b-472b-a342-85e1dac86ea9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:16.342021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5967f-c94b-472b-a342-85e1dac86ea9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:16.375427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:16.376216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:16.376491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:16.376764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:16.377408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:16.378796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:16.389746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 05:49:16.390844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 647/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:49:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:16.397001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:16.489984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e9933-ca6a-4036-b4e1-be43988cf18d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:16.521330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:16.522006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:16.522291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:16.522569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:16.523272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:16.523581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:16.524945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e470e3-8fb6-4df6-ba48-a1827bec8602 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:16.530156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 644/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Aug 23 05:49:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:16.536633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:16.630298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7d4d-55e1-4c19-8915-4fd4bbd57239 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:16.661871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:16.662456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:16.662735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:16.663003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:16.663693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:16.663989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:16.665332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15d40a-9b35-40c8-90c8-1d0bc51554e8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:16.670225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 648/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Aug 23 05:49:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:18.977871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc943a-c673-4532-ac70-1cf5dff66872 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:18.978436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc943a-c673-4532-ac70-1cf5dff66872 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:18.978436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc943a-c673-4532-ac70-1cf5dff66872 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:18.981001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 645/1293] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:18.986684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1ed1-0bda-4e12-992e-f189b6dd211e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:18.987213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1ed1-0bda-4e12-992e-f189b6dd211e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:18.987294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1ed1-0bda-4e12-992e-f189b6dd211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:19.005229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-408a1ed1-0bda-4e12-992e-f189b6dd211e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:19.006481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-408a1ed1-0bda-4e12-992e-f189b6dd211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:19.074468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 649/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:19.097182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc943a-c673-4532-ac70-1cf5dff66872 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:19.200595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc943a-c673-4532-ac70-1cf5dff66872 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:19.234396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:19.234987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:19.235266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:19.235539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:19.236277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:19.237692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddac8e-a457-4855-9284-66bba5b497f1 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:19.313884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 646/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Aug 23 05:49:19 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:49:21.679016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6bda-7cf0-4c40-9de6-180032a4542e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:21.679566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6bda-7cf0-4c40-9de6-180032a4542e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:21.679566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6bda-7cf0-4c40-9de6-180032a4542e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:21.681248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 650/1296] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:21.686352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:21.686772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:21.687009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:21.703254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:21.704405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:21.773095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 647/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:21.798051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6bda-7cf0-4c40-9de6-180032a4542e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:21.895165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6bda-7cf0-4c40-9de6-180032a4542e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:21.927437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:21.928216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 05:49:21.953932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 651/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:49:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:21.954414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:22.046583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c321-81e1-4f6f-9ef6-88af5c9234fb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:22.078601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:22.079257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:22.079536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:22.079808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:22.080507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:22.080807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:22.082203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:22.087069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 648/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Aug 23 05:49:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:22.093064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:22.187997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb699-5f81-4b78-89a6-5f6731790bbd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:22.219295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:22.219940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:22.220219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:22.220493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:22.221265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] RBAC: Adding query filter params (interface=public, service_id=90f281b696864a1a804306e495f2dece, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:22.221602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:22.222959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266bb2-acd8-4c0b-ad17-d18113d0b9b4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:22.227685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 652/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Aug 23 05:49:22 2022] GET /identity/v3/endpoints?service_id=90f281b696864a1a804306e495f2dece&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:22.234046 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:22.327491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b328-d8dc-410c-9d16-f4979b6b84d9 None admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:22.360491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:22.361143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:22.361419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:22.361717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:22.362387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:22.363749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774257a0-9f2b-4718-96e8-5f6fcde7777c None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:22.370302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 649/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Aug 23 05:49:22 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:49:24.710929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d3cd-aa74-404f-850d-ace6cb2f2f82 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:24.711441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d3cd-aa74-404f-850d-ace6cb2f2f82 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:24.711441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d3cd-aa74-404f-850d-ace6cb2f2f82 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:24.713165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 653/1302] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:49:24.719015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:24.719451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:24.719615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:24.736990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:49:24.738303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:49:24.801640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 650/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:49:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 05:49:24.824149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d3cd-aa74-404f-850d-ace6cb2f2f82 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:24.921456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d3cd-aa74-404f-850d-ace6cb2f2f82 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:24.952520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:24.953292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:24.953601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:24.953872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:24.954509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:24.955856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:24.967060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING keystone.server.flask.application [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 05:49:24.968186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 654/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Aug 23 05:49:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 05:49:24.974240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:25.068962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a3aa-5a8e-49ab-9919-5f18c0d6bf9e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:25.100645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:25.101289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:25.101600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:25.101877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] PATH_INFO: `/v3/services` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:25.102572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 05:49:25.102874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:25.104297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7473c-ddb1-46f9-ba10-1a054a3327c8 None admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:25.110139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 651/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Aug 23 05:49:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 05:49:25.115579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:49:25.212240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0bb1-ef84-4e08-b4fe-f6c585daa896 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:49:25.245404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:49:25.246005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:49:25.246871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:49:25.247149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:49:25.247871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:49:25.249231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0e6f8-2538-4e1c-aefa-f0fc00af3572 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:49:25.337309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 655/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 05:49:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 05:55:56.209681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:56.210781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:56.211281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:56.219088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276769b0-6008-40d3-87e2-996ae7c2cb85 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:56.219926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276769b0-6008-40d3-87e2-996ae7c2cb85 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:56.220463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276769b0-6008-40d3-87e2-996ae7c2cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:56.224062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 652/1307] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:55:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:55:56.303562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-276769b0-6008-40d3-87e2-996ae7c2cb85 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:55:56.305104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-276769b0-6008-40d3-87e2-996ae7c2cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:56.454758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:55:56.455013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 656/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:55:56.455537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:56.590589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c67c49-46ef-4a56-a70d-a71daea954b6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:55:56.700487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:55:56.701518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:56.702037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:56.702615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:56.704012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:55:56.707570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 05:55:56.707570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 05:55:56.707570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 05:55:56.709592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4dfe-4af8-41b9-95f4-ef10ffb00008 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:55:56.739161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 653/1309] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:55:56 2022] GET /identity/v3/projects => generated 2553 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:55:59.126682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87c13-ef0c-4acc-be8d-2691254d3c61 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:59.127241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87c13-ef0c-4acc-be8d-2691254d3c61 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:59.127241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87c13-ef0c-4acc-be8d-2691254d3c61 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:59.129051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 657/1310] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:55:59.134916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8b84-293f-4441-a188-56f832ad37ec None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:59.135333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8b84-293f-4441-a188-56f832ad37ec None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:59.135537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8b84-293f-4441-a188-56f832ad37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:59.202394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-267c8b84-293f-4441-a188-56f832ad37ec None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:55:59.203505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-267c8b84-293f-4441-a188-56f832ad37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:59.298586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 654/1311] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:55:59.349245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:59.349562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:59.349843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:59.351759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 658/1312] 10.222.0.26 () {54 vars in 963 bytes} [Tue Aug 23 05:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:55:59.358031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af57e0-76c4-4cd7-b794-7be24015f7d2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:59.358319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af57e0-76c4-4cd7-b794-7be24015f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:59.358595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af57e0-76c4-4cd7-b794-7be24015f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:59.435809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-94af57e0-76c4-4cd7-b794-7be24015f7d2 None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:55:59.436993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-94af57e0-76c4-4cd7-b794-7be24015f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:59.512690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 655/1313] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Aug 23 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:55:59.521712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:55:59.523255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:59.625087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750f5e1-446c-42bc-be65-77b605d2a234 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:55:59.697732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:55:59.698375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:55:59.698713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:55:59.698995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:55:59.700627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:55:59.806323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:55:59.807682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f26a6-de18-466b-bee6-593ca7a4d379 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:55:59.827644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 659/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:02.424886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:02.425380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:02.425496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:02.427242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 656/1315] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:02.432880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fcc9d-8d16-4cc3-9661-ad841b1b62b9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:02.433319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fcc9d-8d16-4cc3-9661-ad841b1b62b9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:02.433421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fcc9d-8d16-4cc3-9661-ad841b1b62b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:02.504104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-000fcc9d-8d16-4cc3-9661-ad841b1b62b9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:02.505343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-000fcc9d-8d16-4cc3-9661-ad841b1b62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:02.603875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 660/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:02.643259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:02.644804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:02.747693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3ef12-d0e0-4060-8b18-253a7e764a98 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:02.817769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:02.818417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:02.818697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:02.818972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:02.820606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:02.925267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:02.926687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0ffec-279d-4a14-96d0-8d1164202053 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:02.947628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 657/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:05.791509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:05.792027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:05.792121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:05.793872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 661/1318] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:05.799082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173f98-c320-4fef-ae20-10e9c7237f50 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:05.799582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173f98-c320-4fef-ae20-10e9c7237f50 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:05.799676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173f98-c320-4fef-ae20-10e9c7237f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:05.862305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-46173f98-c320-4fef-ae20-10e9c7237f50 None None] MFA Rules not processed for user `6204752a1dd94b6cb3197a2995039443`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:05.863487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-46173f98-c320-4fef-ae20-10e9c7237f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:05.955733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 658/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:05.996301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:05.997880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:06.095161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c5c96-d8c8-4226-b433-655da5ad6f48 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:06.164486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:06.165126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:06.166035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:06.166313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:06.167935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:06.271129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:06.272892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c49e-3c98-46ba-afa5-8b62606d1ea7 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:06.289693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 662/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:09.418218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:09.418719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:09.418814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:09.420574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 659/1321] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:09.425853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f7e5-435f-4cc3-add0-8c8c5742cb59 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:09.426298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f7e5-435f-4cc3-add0-8c8c5742cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:09.426505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f7e5-435f-4cc3-add0-8c8c5742cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:09.489055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3fd3f7e5-435f-4cc3-add0-8c8c5742cb59 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:09.490531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3fd3f7e5-435f-4cc3-add0-8c8c5742cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:09.582261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 663/1322] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:09.622329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:09.623874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:09.720671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6320d-1021-48ec-a353-cfc9d85c9139 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:09.788459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:09.789090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:09.789367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:09.789668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:09.791849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:09.894813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:09.896239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65f1f-8e13-460d-8f17-9a79d31730a6 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:09.913732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 660/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:13.402968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45703-ddbf-4cc4-81c1-dd7ba59d8a80 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:13.403438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45703-ddbf-4cc4-81c1-dd7ba59d8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:13.403535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e45703-ddbf-4cc4-81c1-dd7ba59d8a80 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:13.405300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 664/1324] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:13.410614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bc60-7ef8-4dc8-a3d4-479d14911a24 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:13.411068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bc60-7ef8-4dc8-a3d4-479d14911a24 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:13.411172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24bc60-7ef8-4dc8-a3d4-479d14911a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:13.473364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4c24bc60-7ef8-4dc8-a3d4-479d14911a24 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:13.474567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4c24bc60-7ef8-4dc8-a3d4-479d14911a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:13.565317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 661/1325] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:13.617415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:13.617737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:13.618014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:13.620341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 665/1326] 10.222.0.26 () {54 vars in 963 bytes} [Tue Aug 23 05:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:13.626576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20e7a-0202-453d-a1b9-6442eaa9a748 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:13.626862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20e7a-0202-453d-a1b9-6442eaa9a748 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:13.627136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20e7a-0202-453d-a1b9-6442eaa9a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:13.699156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ffa20e7a-0202-453d-a1b9-6442eaa9a748 None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:13.700241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ffa20e7a-0202-453d-a1b9-6442eaa9a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:13.771863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 662/1327] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Aug 23 05:56:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:13.780734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:13.782298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:13.881875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495214d-06a5-4bb7-8c78-df228feb9e23 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:13.953510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:13.954091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:13.954370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:13.954643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:13.956341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:14.063622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:14.065057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650dba-9913-416c-adea-0998f6753ed9 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:14.082734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 666/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:16.708605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:16.709109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:16.709109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:16.710917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 663/1329] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:16.716168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd1d-c160-40db-b5bb-015f9e66e5cc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:16.716602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd1d-c160-40db-b5bb-015f9e66e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:16.716864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd1d-c160-40db-b5bb-015f9e66e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:16.780809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-db66cd1d-c160-40db-b5bb-015f9e66e5cc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:16.782022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-db66cd1d-c160-40db-b5bb-015f9e66e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:16.878682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 667/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:56:16.915896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:16.917560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:17.019607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3faa5-ce8d-4d50-a69d-817c307049a3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:17.090808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:17.091456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:17.091737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:17.092018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:17.093683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:17.203286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:17.204730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae759ee1-8c8b-4e20-868f-c54eca3a3546 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:17.222423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 664/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:19.615558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:19.616143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:19.616143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:19.618072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 668/1332] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:19.623717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541406-12ec-404d-80fa-de2338922392 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:19.624100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541406-12ec-404d-80fa-de2338922392 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:19.624412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541406-12ec-404d-80fa-de2338922392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:19.687772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-11541406-12ec-404d-80fa-de2338922392 None None] MFA Rules not processed for user `6204752a1dd94b6cb3197a2995039443`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:19.688879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-11541406-12ec-404d-80fa-de2338922392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:19.780900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 665/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:19.819867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:19.821429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:19.921385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743f86-f227-4e8a-a4a7-bac009b1d67a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:19.992165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:19.992816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:19.993098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:19.993952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:19.995595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:20.100381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:20.101875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa348f2-7682-48bc-8add-94f9c0476444 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:20.120185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 669/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:23.095672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:23.096199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:23.096199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:23.098050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 666/1335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:23.103884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1465-80ca-4aa7-93c4-6c534d21143a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:23.104359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1465-80ca-4aa7-93c4-6c534d21143a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:23.104551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1465-80ca-4aa7-93c4-6c534d21143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:23.168002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-834d1465-80ca-4aa7-93c4-6c534d21143a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:23.169245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-834d1465-80ca-4aa7-93c4-6c534d21143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:23.266158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 670/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:23.303788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:23.305311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:23.406347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76522d-ca00-40a8-8029-fe3b7fa4a03e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:23.476076 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:23.476724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:23.477006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:23.477284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:23.479479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:23.589248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:23.590759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577d38-6112-4e87-9ca9-0d606c5434eb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:23.609873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 667/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:25.977949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:25.978526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:25.978526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:25.980292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 671/1338] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:25.985301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18316-6756-42b6-9ba3-fd52caed1139 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:25.985752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18316-6756-42b6-9ba3-fd52caed1139 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:25.985902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18316-6756-42b6-9ba3-fd52caed1139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:26.049853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a2f18316-6756-42b6-9ba3-fd52caed1139 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:26.051091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2f18316-6756-42b6-9ba3-fd52caed1139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:26.144180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 668/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:26.185060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:26.186612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:26.288430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace23022-b3e9-4a9b-aa3d-7da15c07c056 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:26.361915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:26.362556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:26.362839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:26.363113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:26.365417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:26.474010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:26.475458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208fc6-cbc2-40a6-a40c-b607630ea212 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:26.494361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 672/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:29.557035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:29.557634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:29.557634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:29.559423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 669/1341] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:29.564633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172027c-1e26-4d88-b3db-ddbdafd0bf6a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:29.565034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172027c-1e26-4d88-b3db-ddbdafd0bf6a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:29.565185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172027c-1e26-4d88-b3db-ddbdafd0bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:29.609650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b172027c-1e26-4d88-b3db-ddbdafd0bf6a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:29.610940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b172027c-1e26-4d88-b3db-ddbdafd0bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:29.683670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 673/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:29.720462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:29.722600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:29.755835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2838f-6260-4ad7-864d-9e25fb84d444 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:29.759798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:29.760423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:29.760702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:29.760974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:29.769557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:29.770982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6319c95-6356-4c9a-af32-c483babb6d67 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:29.780702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 670/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 05:56:34.364772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934153f-f498-47e5-9813-e93e0e424dad None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:34.365620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934153f-f498-47e5-9813-e93e0e424dad None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:34.365620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934153f-f498-47e5-9813-e93e0e424dad None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:34.367323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 674/1344] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:34.372509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fcdd-d27e-41a5-9356-b1465fe51c80 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:34.372930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fcdd-d27e-41a5-9356-b1465fe51c80 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:34.373203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fcdd-d27e-41a5-9356-b1465fe51c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:34.400872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7db9fcdd-d27e-41a5-9356-b1465fe51c80 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:34.402125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7db9fcdd-d27e-41a5-9356-b1465fe51c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:34.409826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 671/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:34.449200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934153f-f498-47e5-9813-e93e0e424dad None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:34.459791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934153f-f498-47e5-9813-e93e0e424dad None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:34.463898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:34.464615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:34.464964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:34.465316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:34.474187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:34.475623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cec34e-bc60-40b8-a9f6-509371ba8c10 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:34.485481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 675/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:37.826526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999807b2-4fdf-44e4-bd5b-c648e645ed07 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:37.827054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999807b2-4fdf-44e4-bd5b-c648e645ed07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:37.827054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999807b2-4fdf-44e4-bd5b-c648e645ed07 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:37.828848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 672/1347] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:37.834108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a431c5-2666-4981-b245-6b1812b00955 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:37.834541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a431c5-2666-4981-b245-6b1812b00955 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:37.834674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a431c5-2666-4981-b245-6b1812b00955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:37.853297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e9a431c5-2666-4981-b245-6b1812b00955 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:37.854524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e9a431c5-2666-4981-b245-6b1812b00955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:37.862406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 676/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:37.901067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999807b2-4fdf-44e4-bd5b-c648e645ed07 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:37.911808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999807b2-4fdf-44e4-bd5b-c648e645ed07 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:37.915392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:37.916014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:37.916293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:37.916562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:37.925711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:37.927143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f4eb-162c-4bb0-ae9b-f8f6ce6795f8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:37.936722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 673/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:42.344424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409e842-43ec-4da0-8b97-f107e509fdbc None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:42.344424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409e842-43ec-4da0-8b97-f107e509fdbc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:42.344424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409e842-43ec-4da0-8b97-f107e509fdbc None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:42.345810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 677/1350] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:42.351034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d021c-000f-42d7-9eb6-e61922792557 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:42.351773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d021c-000f-42d7-9eb6-e61922792557 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:42.351773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d021c-000f-42d7-9eb6-e61922792557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:42.369519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1d5d021c-000f-42d7-9eb6-e61922792557 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:42.370688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1d5d021c-000f-42d7-9eb6-e61922792557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:42.379830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 674/1351] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:42.417982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409e842-43ec-4da0-8b97-f107e509fdbc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:42.429285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409e842-43ec-4da0-8b97-f107e509fdbc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:42.433118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:42.433991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:42.434271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:42.434707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:42.444902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:42.448023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ecaa4-7ba7-4b25-b907-0a353d920d02 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:42.458344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 678/1352] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:56:47.759058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4ba62-1287-4358-a4f3-12cb77ea8f5d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:47.760050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4ba62-1287-4358-a4f3-12cb77ea8f5d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:47.760495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4ba62-1287-4358-a4f3-12cb77ea8f5d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:47.762882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 675/1353] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 05:56:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:47.783477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b698740-03f4-4837-8c01-9ac212625c27 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:47.783477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b698740-03f4-4837-8c01-9ac212625c27 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:47.783477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b698740-03f4-4837-8c01-9ac212625c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:47.849050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7b698740-03f4-4837-8c01-9ac212625c27 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:47.851181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7b698740-03f4-4837-8c01-9ac212625c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:47.946659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 679/1354] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:52.490467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeecd-2360-4cc4-af4a-980c6a93568e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:52.491252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeecd-2360-4cc4-af4a-980c6a93568e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:52.491252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeecd-2360-4cc4-af4a-980c6a93568e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:52.493863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 676/1355] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 05:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:52.498979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca485-4b4c-414c-82c8-12fb00322d54 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:52.499625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca485-4b4c-414c-82c8-12fb00322d54 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:52.500043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca485-4b4c-414c-82c8-12fb00322d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:52.520045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-be8ca485-4b4c-414c-82c8-12fb00322d54 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:52.521315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-be8ca485-4b4c-414c-82c8-12fb00322d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:52.530556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 680/1356] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:54.105626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add77-5655-4085-9790-260b16492c46 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:54.106083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add77-5655-4085-9790-260b16492c46 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:54.106177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add77-5655-4085-9790-260b16492c46 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:54.107938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 677/1357] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 05:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:54.113217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d527-5e83-41fc-be3e-f79469dfe1d6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:54.113682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d527-5e83-41fc-be3e-f79469dfe1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:54.113952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d527-5e83-41fc-be3e-f79469dfe1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:54.132681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b445d527-5e83-41fc-be3e-f79469dfe1d6 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:54.134595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b445d527-5e83-41fc-be3e-f79469dfe1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:54.143152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 681/1358] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 05:56:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:56:58.130981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9c9a-c38b-48fc-8255-40f55b4cd1ac None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:58.131503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9c9a-c38b-48fc-8255-40f55b4cd1ac None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:58.131503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9c9a-c38b-48fc-8255-40f55b4cd1ac None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:58.133309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 678/1359] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:58.138694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602c3e-aa50-4e9c-937e-c59d25643258 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:58.139148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602c3e-aa50-4e9c-937e-c59d25643258 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:58.139490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602c3e-aa50-4e9c-937e-c59d25643258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:58.157281 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f0602c3e-aa50-4e9c-937e-c59d25643258 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:58.158647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f0602c3e-aa50-4e9c-937e-c59d25643258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:58.167247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 682/1360] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:58.215734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a9ba-7081-42e9-ae36-8c5ae07bda50 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:58.216115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a9ba-7081-42e9-ae36-8c5ae07bda50 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:58.216574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a9ba-7081-42e9-ae36-8c5ae07bda50 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:58.218648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 679/1361] 10.222.0.26 () {54 vars in 959 bytes} [Tue Aug 23 05:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:56:58.223920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e01c9-57a5-48ac-ab7d-57eea48fa6e8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:58.224210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e01c9-57a5-48ac-ab7d-57eea48fa6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:58.224483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e01c9-57a5-48ac-ab7d-57eea48fa6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:58.272278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9d3e01c9-57a5-48ac-ab7d-57eea48fa6e8 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:56:58.273791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9d3e01c9-57a5-48ac-ab7d-57eea48fa6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:56:58.353198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 683/1362] 10.222.0.26 () {58 vars in 1056 bytes} [Tue Aug 23 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:56:58.361333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a9ba-7081-42e9-ae36-8c5ae07bda50 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:56:58.376034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a9ba-7081-42e9-ae36-8c5ae07bda50 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:56:58.384565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:56:58.385203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:56:58.385517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:56:58.385955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:56:58.394621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:56:58.396211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2af60-cdf9-487e-9ac1-0976afa14d86 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:56:58.406292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 680/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:00.951328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1618-edae-4a6d-8f1e-6ce243e6d562 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:00.951848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1618-edae-4a6d-8f1e-6ce243e6d562 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:00.952155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1618-edae-4a6d-8f1e-6ce243e6d562 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:00.954330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 684/1364] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:00.959544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5cba-c5ab-4598-ab72-7c916a131bc1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:00.959957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5cba-c5ab-4598-ab72-7c916a131bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:00.960044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5cba-c5ab-4598-ab72-7c916a131bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:00.978691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-631c5cba-c5ab-4598-ab72-7c916a131bc1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:00.979866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-631c5cba-c5ab-4598-ab72-7c916a131bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:00.987685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 681/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:01.032273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1618-edae-4a6d-8f1e-6ce243e6d562 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:01.046788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1618-edae-4a6d-8f1e-6ce243e6d562 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:01.052236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:01.052865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:01.053146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:01.053470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:01.062186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:01.063814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8115e3-91c8-43d9-9bf8-8b866797c298 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:01.074221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 685/1366] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:03.903030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49762-6a31-4cf0-9095-33a2d1f32940 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:03.903563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49762-6a31-4cf0-9095-33a2d1f32940 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:03.903563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49762-6a31-4cf0-9095-33a2d1f32940 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:03.905357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 682/1367] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:03.910555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabf5a-0faf-4b64-bdb0-6381d68adcd1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:03.910996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabf5a-0faf-4b64-bdb0-6381d68adcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:03.911117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabf5a-0faf-4b64-bdb0-6381d68adcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:03.930251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bfbabf5a-0faf-4b64-bdb0-6381d68adcd1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:03.931455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bfbabf5a-0faf-4b64-bdb0-6381d68adcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:03.939375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 686/1368] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:03.996551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c60a-2118-4d59-8907-a45bc0942d9a None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:03.996834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c60a-2118-4d59-8907-a45bc0942d9a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:03.997109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c60a-2118-4d59-8907-a45bc0942d9a None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:03.998908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 683/1369] 10.222.0.26 () {54 vars in 959 bytes} [Tue Aug 23 05:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:04.005282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8a20-84c1-42f7-b6bb-13525612e6b3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:04.005599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8a20-84c1-42f7-b6bb-13525612e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:04.005879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8a20-84c1-42f7-b6bb-13525612e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:04.027604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b81f8a20-84c1-42f7-b6bb-13525612e6b3 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:04.029026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b81f8a20-84c1-42f7-b6bb-13525612e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:04.042466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 687/1370] 10.222.0.26 () {58 vars in 1056 bytes} [Tue Aug 23 05:57:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:04.050463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5c60a-2118-4d59-8907-a45bc0942d9a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:04.068925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5c60a-2118-4d59-8907-a45bc0942d9a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:04.075025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:04.075670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:04.075953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:04.076232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:04.084969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:04.086649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ea71f-0c48-46d6-9bda-db3807e9e4f3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:04.097200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 684/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:06.402191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798d021-b560-4080-86bd-4f00d3535026 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.402684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798d021-b560-4080-86bd-4f00d3535026 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.402783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798d021-b560-4080-86bd-4f00d3535026 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.404490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 688/1372] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:06.409738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675148d0-70f7-4386-af4b-8fd094dfb9b4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.410151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675148d0-70f7-4386-af4b-8fd094dfb9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.410285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675148d0-70f7-4386-af4b-8fd094dfb9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.428623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-675148d0-70f7-4386-af4b-8fd094dfb9b4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:06.430510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-675148d0-70f7-4386-af4b-8fd094dfb9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:06.438340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 685/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:06.674385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84fbf3-85a7-4a8a-9483-ec685246b236 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.674600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84fbf3-85a7-4a8a-9483-ec685246b236 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.675093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84fbf3-85a7-4a8a-9483-ec685246b236 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.677063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 689/1374] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:57:06.682614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c6bd-0d87-4f2b-9a19-8a11c9b62a79 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.682976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c6bd-0d87-4f2b-9a19-8a11c9b62a79 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.683260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c6bd-0d87-4f2b-9a19-8a11c9b62a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.703310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8861c6bd-0d87-4f2b-9a19-8a11c9b62a79 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:06.704335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8861c6bd-0d87-4f2b-9a19-8a11c9b62a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:06.719888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 686/1375] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:06.727369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb92e-a930-4e8b-92eb-e3aa503cac3a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.727665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb92e-a930-4e8b-92eb-e3aa503cac3a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.727954 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb92e-a930-4e8b-92eb-e3aa503cac3a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.729815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 690/1376] 10.222.0.26 () {54 vars in 961 bytes} [Tue Aug 23 05:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:06.734791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6bcf-986b-4d87-9110-f31e608cf70a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.735160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6bcf-986b-4d87-9110-f31e608cf70a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.735517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6bcf-986b-4d87-9110-f31e608cf70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.763559 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb92e-a930-4e8b-92eb-e3aa503cac3a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:06.778692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb92e-a930-4e8b-92eb-e3aa503cac3a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:06.785517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:06.786158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.786440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.786714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.795989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:06.797601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:06.807192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5a3f6bcf-986b-4d87-9110-f31e608cf70a None None] MFA Rules not processed for user `0b52b24c45b04205922a4394f8eddea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:06.807512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 691/1377] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:06.808563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5a3f6bcf-986b-4d87-9110-f31e608cf70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:06.869944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 687/1378] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Aug 23 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:06.877715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:06.887519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208565f-e96f-460b-94e5-80762021a7d7 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:06.891299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:06.891990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:06.892240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:06.892701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:06.904124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:06.905609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2490e-da94-4bde-aa1e-635e1357426b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:06.915960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 692/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:09.330895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26815-cf22-4f33-bcac-56cb2c34bec0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:09.330895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26815-cf22-4f33-bcac-56cb2c34bec0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:09.331373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26815-cf22-4f33-bcac-56cb2c34bec0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:09.332777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 688/1380] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:09.338269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324631-276e-4fbe-bc23-66a542b23388 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:09.338716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324631-276e-4fbe-bc23-66a542b23388 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:09.338808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324631-276e-4fbe-bc23-66a542b23388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:09.357621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-73324631-276e-4fbe-bc23-66a542b23388 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:09.358808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-73324631-276e-4fbe-bc23-66a542b23388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:09.367544 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 693/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:09.412795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26815-cf22-4f33-bcac-56cb2c34bec0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:09.428004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26815-cf22-4f33-bcac-56cb2c34bec0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:09.436031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:09.436665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:09.436941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:09.437213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:09.446358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:09.447981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e782e6-3789-4e09-af1d-7711f14bf362 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:09.457501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 689/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 05:57:12.027749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac667b-33b9-47b5-9b1f-d0551917b16c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:12.028274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac667b-33b9-47b5-9b1f-d0551917b16c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:12.028357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac667b-33b9-47b5-9b1f-d0551917b16c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:12.030201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 694/1383] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:12.035660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec799b-f550-43f2-a67e-81843c3e45cd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:12.036454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec799b-f550-43f2-a67e-81843c3e45cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:12.036736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec799b-f550-43f2-a67e-81843c3e45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:12.055481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-50ec799b-f550-43f2-a67e-81843c3e45cd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:12.056677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-50ec799b-f550-43f2-a67e-81843c3e45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:12.065098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 690/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:12.110977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac667b-33b9-47b5-9b1f-d0551917b16c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:12.126632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac667b-33b9-47b5-9b1f-d0551917b16c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:12.135296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:12.135942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:12.136223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:12.136496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:12.146990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:12.149259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f5590-0bb2-42b6-9223-54f2f351f936 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:12.161243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 695/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:14.768669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083792f-8391-4d4b-b140-b04dfbda1962 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:14.769274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083792f-8391-4d4b-b140-b04dfbda1962 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:14.769274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083792f-8391-4d4b-b140-b04dfbda1962 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:14.771026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 691/1386] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:14.777411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7d56-44bc-4a3f-af73-e49b9721d216 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:14.777937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7d56-44bc-4a3f-af73-e49b9721d216 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:14.778060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7d56-44bc-4a3f-af73-e49b9721d216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:14.795815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-72fc7d56-44bc-4a3f-af73-e49b9721d216 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:14.797086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-72fc7d56-44bc-4a3f-af73-e49b9721d216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:14.805877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 696/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:14.847070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083792f-8391-4d4b-b140-b04dfbda1962 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:14.862421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083792f-8391-4d4b-b140-b04dfbda1962 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:14.868877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:14.869641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:14.869872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:14.870130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:14.878697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:14.880290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbb73e-f150-4c39-a035-9bc98be63d2e service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:14.890348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 692/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:17.273850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe14-b300-461f-82bf-90ca7b621f09 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:17.274410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe14-b300-461f-82bf-90ca7b621f09 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:17.274508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe14-b300-461f-82bf-90ca7b621f09 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:17.276314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 697/1389] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:57:17.281493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d486-2fb0-44dd-bf6a-0f531f109150 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:17.281917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d486-2fb0-44dd-bf6a-0f531f109150 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:17.282055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d486-2fb0-44dd-bf6a-0f531f109150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:17.299285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b036d486-2fb0-44dd-bf6a-0f531f109150 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:17.300455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b036d486-2fb0-44dd-bf6a-0f531f109150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:17.308639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 693/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:17.354179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cfe14-b300-461f-82bf-90ca7b621f09 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:17.369301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cfe14-b300-461f-82bf-90ca7b621f09 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:17.375061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:17.375670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:17.375995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:17.376280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:17.385583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:17.387185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9b9ec-e602-404b-addb-d503603e143d service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:17.396614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 698/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:19.966343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c78f0-bf65-454f-ac87-1426d58efd09 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:19.966899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c78f0-bf65-454f-ac87-1426d58efd09 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:19.966899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c78f0-bf65-454f-ac87-1426d58efd09 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:19.968695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 694/1392] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:19.975403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f127443-ff13-4c22-ae61-cce579837e6d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:19.975925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f127443-ff13-4c22-ae61-cce579837e6d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:19.975925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f127443-ff13-4c22-ae61-cce579837e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:19.996838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5f127443-ff13-4c22-ae61-cce579837e6d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:19.998068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5f127443-ff13-4c22-ae61-cce579837e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:20.006053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 699/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:20.050780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c78f0-bf65-454f-ac87-1426d58efd09 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:20.064838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c78f0-bf65-454f-ac87-1426d58efd09 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:20.070471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:20.071099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:20.071378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:20.071652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:20.079888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:20.081495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2677-99d9-4467-ba4f-380027edf364 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:20.092258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 695/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:22.581103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161de26-c554-4a5e-a510-e466d9eb42ce None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:22.581729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161de26-c554-4a5e-a510-e466d9eb42ce None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:22.581729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161de26-c554-4a5e-a510-e466d9eb42ce None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:22.583492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 700/1395] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:22.588771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa51f-991f-466f-8563-0a6e84be04ed None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:22.589232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa51f-991f-466f-8563-0a6e84be04ed None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:22.589416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa51f-991f-466f-8563-0a6e84be04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:22.607248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-933aa51f-991f-466f-8563-0a6e84be04ed None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:22.608437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-933aa51f-991f-466f-8563-0a6e84be04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:22.616515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 696/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:22.661472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161de26-c554-4a5e-a510-e466d9eb42ce None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:22.676159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161de26-c554-4a5e-a510-e466d9eb42ce None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:22.682115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:22.682734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:22.683026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:22.683284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:22.691294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:22.692864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0715-8a6c-43ba-a23d-3d8822029e97 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:22.702195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 701/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:23.201522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e467d2-3114-4c2e-9749-d614d1b6f9bf None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:23.201728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e467d2-3114-4c2e-9749-d614d1b6f9bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:23.202025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e467d2-3114-4c2e-9749-d614d1b6f9bf None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:23.203747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 697/1398] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:23.209063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c620-e387-4156-a9be-418584c211d7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:23.213683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c620-e387-4156-a9be-418584c211d7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:23.213683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c620-e387-4156-a9be-418584c211d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:23.228394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-29f4c620-e387-4156-a9be-418584c211d7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:23.229623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-29f4c620-e387-4156-a9be-418584c211d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:23.237530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 702/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:57:23.295465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3966-5c32-4e5e-b19b-ae3b73da2e4d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:23.295883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3966-5c32-4e5e-b19b-ae3b73da2e4d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:23.296184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3966-5c32-4e5e-b19b-ae3b73da2e4d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:23.298023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 698/1400] 10.222.0.26 () {54 vars in 961 bytes} [Tue Aug 23 05:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:23.303173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a980-dfcc-4676-910b-526c39b6ed5f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:23.303467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a980-dfcc-4676-910b-526c39b6ed5f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:23.303745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a980-dfcc-4676-910b-526c39b6ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:23.352068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9632a980-dfcc-4676-910b-526c39b6ed5f None None] MFA Rules not processed for user `f0d9910443224e84af4396d4b9af0656`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:23.353794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9632a980-dfcc-4676-910b-526c39b6ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:23.414446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 703/1401] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Aug 23 05:57:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:23.422048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3966-5c32-4e5e-b19b-ae3b73da2e4d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:23.432245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3966-5c32-4e5e-b19b-ae3b73da2e4d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:23.435700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:23.436314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:23.436591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:23.436861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:23.445938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:23.447379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e494b-c92b-44d8-b271-0ca7d7724783 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:23.456604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 699/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 05:57:24.088147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad25-0d29-4dad-b689-086de9a5f385 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:24.091815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad25-0d29-4dad-b689-086de9a5f385 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:24.091815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ad25-0d29-4dad-b689-086de9a5f385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:24.136890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f3e4ad25-0d29-4dad-b689-086de9a5f385 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:24.138106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f3e4ad25-0d29-4dad-b689-086de9a5f385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:24.199935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 704/1403] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 05:57:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:24.246784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b368-d475-4885-b9cb-e2010f84d870 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:24.247261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b368-d475-4885-b9cb-e2010f84d870 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:24.247495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b368-d475-4885-b9cb-e2010f84d870 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:24.249281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 700/1404] 10.222.0.26 () {54 vars in 942 bytes} [Tue Aug 23 05:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:24.255508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb54c-39c5-480a-9f6f-6af488c933de None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:24.255885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb54c-39c5-480a-9f6f-6af488c933de None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:24.256232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb54c-39c5-480a-9f6f-6af488c933de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:24.302288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-375cb54c-39c5-480a-9f6f-6af488c933de None None] MFA Rules not processed for user `ffe3c9bd5d944466b9b8d1fd3f904026`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:24.303476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-375cb54c-39c5-480a-9f6f-6af488c933de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:24.372774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 705/1405] 10.222.0.26 () {58 vars in 1039 bytes} [Tue Aug 23 05:57:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:24.382087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b368-d475-4885-b9cb-e2010f84d870 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:24.395062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b368-d475-4885-b9cb-e2010f84d870 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:24.399989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:24.400609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:24.400893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:24.401167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:24.409057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:24.410688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb740e-fefe-4304-8cca-fb40d0d33c7b service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:24.419053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 701/1406] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 05:57:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 05:57:25.266543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3c63-df8d-4e3e-a9fe-ccbe8c60c53b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:25.267792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3c63-df8d-4e3e-a9fe-ccbe8c60c53b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:25.268426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3c63-df8d-4e3e-a9fe-ccbe8c60c53b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:25.270415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 706/1407] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:25.276400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edf68c-f494-4539-ae84-55c67c53dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:25.277260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edf68c-f494-4539-ae84-55c67c53dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:25.277608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edf68c-f494-4539-ae84-55c67c53dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:25.309509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-62edf68c-f494-4539-ae84-55c67c53dfe3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:25.311023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-62edf68c-f494-4539-ae84-55c67c53dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:25.319622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 702/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:25.368392 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3c63-df8d-4e3e-a9fe-ccbe8c60c53b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:25.386962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3c63-df8d-4e3e-a9fe-ccbe8c60c53b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:25.393039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:25.394083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:25.394520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:25.395020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:25.404456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:25.406155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efe150-9d85-44a8-bf87-48991898dc29 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:25.415580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 707/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 05:57:27.921071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3315b3-72a8-4bec-9375-b2ff2e8a3667 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:27.921952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3315b3-72a8-4bec-9375-b2ff2e8a3667 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:27.922406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3315b3-72a8-4bec-9375-b2ff2e8a3667 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:27.924420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 703/1410] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:27.929594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c689-ad32-4ce5-b0dc-e8f5d7cdcf87 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:27.930028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c689-ad32-4ce5-b0dc-e8f5d7cdcf87 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:27.930214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006c689-ad32-4ce5-b0dc-e8f5d7cdcf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:27.950013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b006c689-ad32-4ce5-b0dc-e8f5d7cdcf87 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:27.951224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b006c689-ad32-4ce5-b0dc-e8f5d7cdcf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:27.959257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 708/1411] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:28.009750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3315b3-72a8-4bec-9375-b2ff2e8a3667 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:28.026055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3315b3-72a8-4bec-9375-b2ff2e8a3667 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:28.032435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:28.033262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:28.033617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:28.033964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:28.043092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:28.044741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cacd9-c372-4f5f-8de6-a8d09d2a8390 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:28.057148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 704/1412] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:49.200599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c06f1-d708-4f17-a0e4-6c967a9cf6f5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:49.201249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c06f1-d708-4f17-a0e4-6c967a9cf6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:49.201249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c06f1-d708-4f17-a0e4-6c967a9cf6f5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:49.202942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 709/1413] 10.222.0.26 () {54 vars in 918 bytes} [Tue Aug 23 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:49.208101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d23e-ecc0-49b6-a732-eb434cf94f45 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:49.208625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d23e-ecc0-49b6-a732-eb434cf94f45 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:49.208733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d23e-ecc0-49b6-a732-eb434cf94f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:49.227229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a0e2d23e-ecc0-49b6-a732-eb434cf94f45 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:49.228411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0e2d23e-ecc0-49b6-a732-eb434cf94f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:49.236735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 705/1414] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Aug 23 05:57:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:49.250619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c04a-fe56-4640-8973-523f64476897 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:49.250908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c04a-fe56-4640-8973-523f64476897 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:49.251187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c04a-fe56-4640-8973-523f64476897 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:49.252914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 710/1415] 10.222.0.26 () {54 vars in 918 bytes} [Tue Aug 23 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:49.258016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b7fe-478b-4799-beff-b17140e8b2db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:49.258304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b7fe-478b-4799-beff-b17140e8b2db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:49.258608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b7fe-478b-4799-beff-b17140e8b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:49.276383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-caf3b7fe-478b-4799-beff-b17140e8b2db None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:49.277583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-caf3b7fe-478b-4799-beff-b17140e8b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:49.286388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 706/1416] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Aug 23 05:57:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:52.098084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5634a-b278-4b64-89a3-643bfd8cdf89 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:52.098666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5634a-b278-4b64-89a3-643bfd8cdf89 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:52.098666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5634a-b278-4b64-89a3-643bfd8cdf89 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:52.100977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:52.106140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325c68-a692-40cd-8647-e596c2cf75ef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:52.106583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325c68-a692-40cd-8647-e596c2cf75ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:52.106697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b325c68-a692-40cd-8647-e596c2cf75ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:52.124321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6b325c68-a692-40cd-8647-e596c2cf75ef None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:52.125537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6b325c68-a692-40cd-8647-e596c2cf75ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:52.133272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:52.175353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5634a-b278-4b64-89a3-643bfd8cdf89 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:52.189501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5634a-b278-4b64-89a3-643bfd8cdf89 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:52.194924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:52.195546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:52.195827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:52.196101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:52.204039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:52.205651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a098fdd-46fb-4d47-b7bb-e05ce258f8ed service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:52.215261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 712/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:53.595991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74746e-fff2-473f-91f6-0284eda4ec66 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:53.596583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74746e-fff2-473f-91f6-0284eda4ec66 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:53.596583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74746e-fff2-473f-91f6-0284eda4ec66 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:53.598369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:53.604021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a573-3373-4f12-87a6-e9b0f8b0e503 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:53.604496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a573-3373-4f12-87a6-e9b0f8b0e503 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:53.604594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a573-3373-4f12-87a6-e9b0f8b0e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:53.623343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-10c5a573-3373-4f12-87a6-e9b0f8b0e503 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:53.624516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-10c5a573-3373-4f12-87a6-e9b0f8b0e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:53.632628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:53.798182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74746e-fff2-473f-91f6-0284eda4ec66 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:53.812114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74746e-fff2-473f-91f6-0284eda4ec66 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:53.817407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:53.818052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:53.818333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:53.818606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:53.826973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:53.828558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85bf42-bafe-4679-820c-d7e06a109f34 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:53.838224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 709/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 05:57:55.179189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78313-3dc1-4332-b11d-d20473445e66 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:55.179711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78313-3dc1-4332-b11d-d20473445e66 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:55.179711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78313-3dc1-4332-b11d-d20473445e66 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:55.181445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:55.186453 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1931-edc0-4c60-ab32-89fa3fce390c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:55.186840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1931-edc0-4c60-ab32-89fa3fce390c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:55.187031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1931-edc0-4c60-ab32-89fa3fce390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:55.205071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f23d1931-edc0-4c60-ab32-89fa3fce390c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:55.206278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f23d1931-edc0-4c60-ab32-89fa3fce390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:55.213903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:55.368663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78313-3dc1-4332-b11d-d20473445e66 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:55.383894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78313-3dc1-4332-b11d-d20473445e66 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:55.389167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:55.389833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:55.390109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:55.390379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:55.398352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:55.399926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1a26-b07f-4bad-9da9-6068614b0eec service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:55.409152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 715/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:56.751426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432b8e-9370-4dd2-a3ae-9b5ff9fa276d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:56.751981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432b8e-9370-4dd2-a3ae-9b5ff9fa276d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:56.751981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2432b8e-9370-4dd2-a3ae-9b5ff9fa276d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:56.753823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:56.759463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadec38-e2c6-48dc-8d42-8b0389370ede None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:56.759884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadec38-e2c6-48dc-8d42-8b0389370ede None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:56.759979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadec38-e2c6-48dc-8d42-8b0389370ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:56.778049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6eadec38-e2c6-48dc-8d42-8b0389370ede None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:56.779242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6eadec38-e2c6-48dc-8d42-8b0389370ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:56.787013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:56.941160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2432b8e-9370-4dd2-a3ae-9b5ff9fa276d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:56.955455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2432b8e-9370-4dd2-a3ae-9b5ff9fa276d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:56.960821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:56.961499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:56.961787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:56.962067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:56.970126 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:56.971710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4d182-c5ab-4fa9-8f50-6218dfc7fcd8 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:56.981397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 712/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:58.300520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79bbe7-67a2-41db-9112-446bc14bef59 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:58.301036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79bbe7-67a2-41db-9112-446bc14bef59 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:58.301036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79bbe7-67a2-41db-9112-446bc14bef59 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:58.302778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:58.308259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634d40-3df7-4014-8929-a9b1251113e4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:58.308657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634d40-3df7-4014-8929-a9b1251113e4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:58.308835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634d40-3df7-4014-8929-a9b1251113e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:58.327026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6d634d40-3df7-4014-8929-a9b1251113e4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:58.328205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6d634d40-3df7-4014-8929-a9b1251113e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:58.335873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:57:58.498350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79bbe7-67a2-41db-9112-446bc14bef59 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:57:58.512230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79bbe7-67a2-41db-9112-446bc14bef59 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:57:58.517501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:57:58.518124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:58.518395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:58.518663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:58.526474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:57:58.528038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2329-af3b-496a-b380-b6c68e86b66d service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:57:58.536984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 718/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:57:59.879647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e01e-ab33-4366-88c2-d88533489829 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:59.880230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e01e-ab33-4366-88c2-d88533489829 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:59.880341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e01e-ab33-4366-88c2-d88533489829 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:59.882625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:57:59.887739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e79fa-b22c-4ce2-85ec-9c76c7c1396d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:57:59.888156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e79fa-b22c-4ce2-85ec-9c76c7c1396d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:57:59.888296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e79fa-b22c-4ce2-85ec-9c76c7c1396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:57:59.906620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-466e79fa-b22c-4ce2-85ec-9c76c7c1396d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:57:59.907783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-466e79fa-b22c-4ce2-85ec-9c76c7c1396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:57:59.915493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:00.073706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e01e-ab33-4366-88c2-d88533489829 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:00.087994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e01e-ab33-4366-88c2-d88533489829 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:00.093180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:00.093829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:00.094110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:00.094381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:00.102613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:00.104201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5db2d-09d7-455e-8cf7-a37e108a5246 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:00.113253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 715/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:01.458960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e834cb3-0d49-4042-9077-2a81ad9b6131 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:01.459513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e834cb3-0d49-4042-9077-2a81ad9b6131 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:01.459513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e834cb3-0d49-4042-9077-2a81ad9b6131 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:01.461312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:01.466374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec34f-987f-4a0b-a2e1-e40bad53e628 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:01.466771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec34f-987f-4a0b-a2e1-e40bad53e628 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:01.466963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecec34f-987f-4a0b-a2e1-e40bad53e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:01.486196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3ecec34f-987f-4a0b-a2e1-e40bad53e628 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:01.487414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3ecec34f-987f-4a0b-a2e1-e40bad53e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:01.496013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:01.647359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e834cb3-0d49-4042-9077-2a81ad9b6131 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:01.661225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e834cb3-0d49-4042-9077-2a81ad9b6131 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:01.667168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:01.667791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:01.668075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:01.668351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:01.676263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:01.677868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aaf46-3657-4231-97a0-1cc5c9b44309 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:01.687558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 721/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:03.048448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd16bf-b97c-48bf-a355-f20d12d900be None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:03.049019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd16bf-b97c-48bf-a355-f20d12d900be None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:03.049019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd16bf-b97c-48bf-a355-f20d12d900be None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:03.050818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:03.056517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7380-1c6c-44f0-91b1-7ab4d658dd23 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:03.056936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7380-1c6c-44f0-91b1-7ab4d658dd23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:03.057056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7380-1c6c-44f0-91b1-7ab4d658dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:03.074851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-14bf7380-1c6c-44f0-91b1-7ab4d658dd23 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:03.076049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-14bf7380-1c6c-44f0-91b1-7ab4d658dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:03.083784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:58:03.234623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd16bf-b97c-48bf-a355-f20d12d900be None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:03.248650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd16bf-b97c-48bf-a355-f20d12d900be None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:03.253935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:03.254563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:03.254837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:03.255107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:03.262940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:03.264521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c9da7-2b2c-4fb0-9ba2-1e5eab8fe533 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:03.274078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 718/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:04.627288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9773e-ecc2-4e93-9832-beeb5c1bcab5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:04.627854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9773e-ecc2-4e93-9832-beeb5c1bcab5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:04.627854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9773e-ecc2-4e93-9832-beeb5c1bcab5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:04.629716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 05:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:04.634743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453352-59e9-4ce4-880e-67e23e7716f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:04.635174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453352-59e9-4ce4-880e-67e23e7716f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:04.635299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453352-59e9-4ce4-880e-67e23e7716f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:04.653003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5a453352-59e9-4ce4-880e-67e23e7716f8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:04.654217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5a453352-59e9-4ce4-880e-67e23e7716f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:04.662089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:04.813713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9773e-ecc2-4e93-9832-beeb5c1bcab5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:04.827797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9773e-ecc2-4e93-9832-beeb5c1bcab5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:04.833130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:04.833789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:04.834589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:04.834864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:04.842699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:04.844269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b0d5-41fc-4cb7-827a-bf826a50432a service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:04.854127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 724/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:07.048297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020fb95-8963-49e7-b435-0d0c3fa9bd5d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:07.048882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020fb95-8963-49e7-b435-0d0c3fa9bd5d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:07.048882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020fb95-8963-49e7-b435-0d0c3fa9bd5d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:07.050667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:07.056344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628be0c-df8b-4956-937d-4adbef130b93 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:07.056749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628be0c-df8b-4956-937d-4adbef130b93 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:07.056975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628be0c-df8b-4956-937d-4adbef130b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:07.075176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8628be0c-df8b-4956-937d-4adbef130b93 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:07.076351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8628be0c-df8b-4956-937d-4adbef130b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:07.083974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:07.122451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020fb95-8963-49e7-b435-0d0c3fa9bd5d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:07.133346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020fb95-8963-49e7-b435-0d0c3fa9bd5d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:07.136779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:07.137393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:07.137698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:07.137970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:07.146471 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:07.147883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da677-736b-483b-b299-61ac59a4bc31 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:07.156843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 721/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:09.663511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5dea0-7865-4072-9acf-2e8d2d560e47 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:09.664070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5dea0-7865-4072-9acf-2e8d2d560e47 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:09.664070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5dea0-7865-4072-9acf-2e8d2d560e47 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:09.666043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:09.671492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fb007-2da9-435d-9a98-d424dcc9fce8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:09.671933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fb007-2da9-435d-9a98-d424dcc9fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:09.672069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fb007-2da9-435d-9a98-d424dcc9fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:09.689549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-624fb007-2da9-435d-9a98-d424dcc9fce8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:09.690717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-624fb007-2da9-435d-9a98-d424dcc9fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:09.699100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:09.738225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5dea0-7865-4072-9acf-2e8d2d560e47 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:09.749198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5dea0-7865-4072-9acf-2e8d2d560e47 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:09.752811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:09.753457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:09.753792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:09.754066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:09.763347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:09.764780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6443a-df8d-4d5c-be55-023d3464ea2e service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:09.774525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 727/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:12.400678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f40b-b6ef-4f5d-aa22-486dae3bbaf2 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:12.401109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f40b-b6ef-4f5d-aa22-486dae3bbaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:12.401211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f40b-b6ef-4f5d-aa22-486dae3bbaf2 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:12.402975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:12.408086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531605-a771-4c75-82fd-33641a35f1c0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:12.408488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531605-a771-4c75-82fd-33641a35f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:12.408637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531605-a771-4c75-82fd-33641a35f1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:12.425912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6a531605-a771-4c75-82fd-33641a35f1c0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:12.427082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6a531605-a771-4c75-82fd-33641a35f1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:12.435256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:12.473746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1f40b-b6ef-4f5d-aa22-486dae3bbaf2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:12.484105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1f40b-b6ef-4f5d-aa22-486dae3bbaf2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:12.487583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:12.488204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:12.488481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:12.488759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:12.498153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:12.499578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508388aa-498f-4410-9bc0-afc51e8d26e6 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:12.509314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 724/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:14.954217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12371a2-9907-408b-b56a-cfaef3dc63d4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:14.954792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12371a2-9907-408b-b56a-cfaef3dc63d4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:14.954902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12371a2-9907-408b-b56a-cfaef3dc63d4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:14.956697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:14.962608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddec9d5-30ad-4d82-ae86-a120a14ff5b3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:14.963032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddec9d5-30ad-4d82-ae86-a120a14ff5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:14.963145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddec9d5-30ad-4d82-ae86-a120a14ff5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:14.980335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dddec9d5-30ad-4d82-ae86-a120a14ff5b3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:14.981529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dddec9d5-30ad-4d82-ae86-a120a14ff5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:14.989110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:15.029027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12371a2-9907-408b-b56a-cfaef3dc63d4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:15.039600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12371a2-9907-408b-b56a-cfaef3dc63d4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:15.043048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:15.043660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:15.043942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:15.044213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:15.052739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:15.054184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aa2db-fe6e-4d6e-918e-6b783b1dc0c2 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:15.063199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 730/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:17.434352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760112e-64d7-4846-aa94-689cc81a9380 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:17.434867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760112e-64d7-4846-aa94-689cc81a9380 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:17.434977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760112e-64d7-4846-aa94-689cc81a9380 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:17.436675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:17.441781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf158-9fe6-413f-b663-07b691ed0187 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:17.442175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf158-9fe6-413f-b663-07b691ed0187 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:17.442333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf158-9fe6-413f-b663-07b691ed0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:17.460178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-edeaf158-9fe6-413f-b663-07b691ed0187 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:17.461345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-edeaf158-9fe6-413f-b663-07b691ed0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:17.468915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:17.506976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760112e-64d7-4846-aa94-689cc81a9380 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:17.517329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760112e-64d7-4846-aa94-689cc81a9380 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:17.520765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:17.521909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:17.522182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:17.522445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:17.530962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:17.532380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5629e1b-6a44-42dc-b49e-76bd6700a8f8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:17.541983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 727/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:19.907621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f810-16fa-43ba-bc64-33de1c219a15 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:19.908179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f810-16fa-43ba-bc64-33de1c219a15 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:19.908179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f810-16fa-43ba-bc64-33de1c219a15 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:19.909990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 05:58:19.916071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3499f-fc13-4e92-ab4d-ad5e167a7c46 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:19.916498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3499f-fc13-4e92-ab4d-ad5e167a7c46 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:19.916636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3499f-fc13-4e92-ab4d-ad5e167a7c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:19.934742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c6a3499f-fc13-4e92-ab4d-ad5e167a7c46 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:19.935931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6a3499f-fc13-4e92-ab4d-ad5e167a7c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:19.943681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:19.982753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7f810-16fa-43ba-bc64-33de1c219a15 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:19.994465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7f810-16fa-43ba-bc64-33de1c219a15 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:19.997892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:19.998517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:19.998795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:19.999070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:20.007717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:20.009154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e969ac-eb10-4b61-87c0-e81932292406 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:20.018509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 733/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:22.381594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2c14-a59c-4708-89f5-565f05d7c83e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:22.382105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2c14-a59c-4708-89f5-565f05d7c83e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:22.382186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2c14-a59c-4708-89f5-565f05d7c83e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:22.383935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:22.389250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60615d-4bbe-4a52-9207-9a3b5ecd2da3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:22.389721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60615d-4bbe-4a52-9207-9a3b5ecd2da3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:22.389859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60615d-4bbe-4a52-9207-9a3b5ecd2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:22.407873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce60615d-4bbe-4a52-9207-9a3b5ecd2da3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:22.408986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce60615d-4bbe-4a52-9207-9a3b5ecd2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:22.416695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:22.454073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2c14-a59c-4708-89f5-565f05d7c83e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:22.464942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2c14-a59c-4708-89f5-565f05d7c83e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:22.468373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:22.469016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:22.469296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:22.469608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:22.478072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:22.479495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86235339-8329-4fc8-a29d-7c5ba7b6e99f service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:22.488573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 730/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:24.858911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:24.859501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:24.859501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:24.861261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:24.867373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28d2f-4b3a-41eb-ad21-a275d3f4943e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:24.867812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28d2f-4b3a-41eb-ad21-a275d3f4943e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:24.867919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28d2f-4b3a-41eb-ad21-a275d3f4943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:24.885565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b8c28d2f-4b3a-41eb-ad21-a275d3f4943e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:24.886737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8c28d2f-4b3a-41eb-ad21-a275d3f4943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:24.894635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:24.933306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:24.935031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:24.947672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888be14-19c1-4a4f-bdd1-728bcb4529b9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:24.951205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:24.951829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:24.952106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:24.952382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:24.961501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:24.962951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c04a-429d-405c-9897-f7f29cd61a0b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:24.972062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 736/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:27.326560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef1a3-bad2-4f7e-bcd2-66cc5ac761e5 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:27.327102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef1a3-bad2-4f7e-bcd2-66cc5ac761e5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:27.327223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef1a3-bad2-4f7e-bcd2-66cc5ac761e5 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:27.328925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:27.334624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021920-f1f9-43ec-aa46-d0e4ef35e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:27.335046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021920-f1f9-43ec-aa46-d0e4ef35e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:27.335180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021920-f1f9-43ec-aa46-d0e4ef35e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:27.353241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-26021920-f1f9-43ec-aa46-d0e4ef35e0e2 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:27.354459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-26021920-f1f9-43ec-aa46-d0e4ef35e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:27.362130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:58:27.399404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef1a3-bad2-4f7e-bcd2-66cc5ac761e5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:27.409910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef1a3-bad2-4f7e-bcd2-66cc5ac761e5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:27.414009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:27.414632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:27.414911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:27.415187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:27.423860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:27.425293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949531f5-7af1-4ae8-9b31-daa406b9913e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:27.434470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 733/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:29.786765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723933df-1b21-42df-9c53-cc5e5bc57ce1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:29.787391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723933df-1b21-42df-9c53-cc5e5bc57ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:29.787391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723933df-1b21-42df-9c53-cc5e5bc57ce1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:29.789075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 738/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 05:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:29.794799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68a62-0924-4614-a3b5-7de5ce3f53e0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:29.795206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68a62-0924-4614-a3b5-7de5ce3f53e0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:29.795389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68a62-0924-4614-a3b5-7de5ce3f53e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:29.812804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a1e68a62-0924-4614-a3b5-7de5ce3f53e0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:29.814037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1e68a62-0924-4614-a3b5-7de5ce3f53e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:29.822293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 734/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 05:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:29.858935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723933df-1b21-42df-9c53-cc5e5bc57ce1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:29.869502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723933df-1b21-42df-9c53-cc5e5bc57ce1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:29.872909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:29.873557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:29.873840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:29.874111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:29.883279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:29.884697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae44b-3740-49d2-b5fe-bf5856a7600e service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:29.893919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 739/1473] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:47.870064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087bb73-d837-47dd-b790-4e2f7aceb95b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:47.870664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087bb73-d837-47dd-b790-4e2f7aceb95b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:47.870664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087bb73-d837-47dd-b790-4e2f7aceb95b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:47.872523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 735/1474] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:47.877693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f049-dd17-405a-8819-01658e1b311e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:47.878118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f049-dd17-405a-8819-01658e1b311e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:47.878258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075f049-dd17-405a-8819-01658e1b311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:47.895670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d075f049-dd17-405a-8819-01658e1b311e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:47.896851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d075f049-dd17-405a-8819-01658e1b311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:47.904613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 740/1475] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:47.951580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159f7d-0ff6-4694-847a-5070d9a3d879 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:47.951892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159f7d-0ff6-4694-847a-5070d9a3d879 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:47.952205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159f7d-0ff6-4694-847a-5070d9a3d879 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:47.954062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 736/1476] 10.222.0.26 () {54 vars in 961 bytes} [Tue Aug 23 05:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:47.958623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23639901-bf8f-4651-b06a-3536abb1e623 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:47.958914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23639901-bf8f-4651-b06a-3536abb1e623 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:47.959194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23639901-bf8f-4651-b06a-3536abb1e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:47.977333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-23639901-bf8f-4651-b06a-3536abb1e623 None None] MFA Rules not processed for user `f0d9910443224e84af4396d4b9af0656`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:47.978543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-23639901-bf8f-4651-b06a-3536abb1e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:47.984873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 741/1477] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Aug 23 05:58:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:47.992787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159f7d-0ff6-4694-847a-5070d9a3d879 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:48.002978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159f7d-0ff6-4694-847a-5070d9a3d879 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:48.006443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:48.007057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:48.007339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:48.007613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:48.016334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:48.025529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd06ff-3972-4786-af68-77636389ed10 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:48.027019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 737/1478] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:50.429981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56b0c-64ad-4842-8d85-0b31154704a7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:50.430487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56b0c-64ad-4842-8d85-0b31154704a7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:50.430487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56b0c-64ad-4842-8d85-0b31154704a7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:50.432229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 742/1479] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:50.437740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0c79-db0c-4ae8-b2b1-3e44841aea4c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:50.438169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0c79-db0c-4ae8-b2b1-3e44841aea4c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:50.438308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0c79-db0c-4ae8-b2b1-3e44841aea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:50.467477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b69a0c79-db0c-4ae8-b2b1-3e44841aea4c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:50.468694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b69a0c79-db0c-4ae8-b2b1-3e44841aea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:50.482147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 738/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:50.506446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56b0c-64ad-4842-8d85-0b31154704a7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:50.518771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56b0c-64ad-4842-8d85-0b31154704a7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:50.523800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:50.524437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:50.524717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:50.524990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:50.525758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:50.527482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 05:58:50.527482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 05:58:50.527482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 05:58:50.528763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb6a9-ed82-4517-bccc-ce6874c746f9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:50.547173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 743/1481] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Aug 23 05:58:50 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 05:58:52.885424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845150ba-a5c1-4315-9260-55fab4f89796 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:52.886020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845150ba-a5c1-4315-9260-55fab4f89796 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:52.886128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845150ba-a5c1-4315-9260-55fab4f89796 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:52.887882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 739/1482] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:52.893025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5e6c-f35c-42d6-8a8f-b4a066160607 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:52.893445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5e6c-f35c-42d6-8a8f-b4a066160607 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:52.893611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae5e6c-f35c-42d6-8a8f-b4a066160607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:52.913074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d1ae5e6c-f35c-42d6-8a8f-b4a066160607 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:52.914291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d1ae5e6c-f35c-42d6-8a8f-b4a066160607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:52.921922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 744/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 05:58:52.963968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845150ba-a5c1-4315-9260-55fab4f89796 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:52.977833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845150ba-a5c1-4315-9260-55fab4f89796 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:52.983212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:52.983837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:52.984116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:52.984390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:52.992574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:52.994208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b574f-90d7-4891-bd46-855f4cf1948b service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:53.003234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 740/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:55.485806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9316a-b935-47b4-a670-af2854c18827 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:55.486365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9316a-b935-47b4-a670-af2854c18827 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:55.486365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9316a-b935-47b4-a670-af2854c18827 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:55.488189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 745/1485] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:55.494116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85b86-1503-4291-a3f0-958ec781e27d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:55.494629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85b86-1503-4291-a3f0-958ec781e27d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:55.494735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85b86-1503-4291-a3f0-958ec781e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:55.512670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-31c85b86-1503-4291-a3f0-958ec781e27d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:55.513881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-31c85b86-1503-4291-a3f0-958ec781e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:55.521557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 741/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:55.557966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9316a-b935-47b4-a670-af2854c18827 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:55.569124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9316a-b935-47b4-a670-af2854c18827 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:55.572677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:55.573331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:55.573644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:55.573924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:55.582644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:55.584076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54137-8ce0-436e-8810-42fa76404ba8 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:55.593243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 746/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:58:57.954293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170829-0f5e-4106-a3a1-9ba6eabca78c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:57.954849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170829-0f5e-4106-a3a1-9ba6eabca78c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:57.954849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170829-0f5e-4106-a3a1-9ba6eabca78c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:57.956617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 742/1488] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:58:57.961786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644f23-c95c-4422-8a2e-c0743110ab8a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:57.962213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644f23-c95c-4422-8a2e-c0743110ab8a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:57.962346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644f23-c95c-4422-8a2e-c0743110ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:57.979845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-95644f23-c95c-4422-8a2e-c0743110ab8a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:58:57.981032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-95644f23-c95c-4422-8a2e-c0743110ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:58:57.989212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 747/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:58:58.027963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170829-0f5e-4106-a3a1-9ba6eabca78c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:58:58.038856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170829-0f5e-4106-a3a1-9ba6eabca78c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:58:58.042356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:58:58.042976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:58:58.043254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:58:58.043527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:58:58.053049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:58:58.054523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25695e23-d6fa-460a-9ae0-e4b90a70f0f5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:58:58.063574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 743/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:59:00.526375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004f19-c669-401a-8af5-e7dda0a727e3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:00.526921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004f19-c669-401a-8af5-e7dda0a727e3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:00.526921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84004f19-c669-401a-8af5-e7dda0a727e3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:00.528752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 748/1491] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:59:00.533985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3bf3-87d9-40ef-a2d3-94544396aa92 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:00.534370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3bf3-87d9-40ef-a2d3-94544396aa92 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:00.534572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3bf3-87d9-40ef-a2d3-94544396aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:00.552440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-518d3bf3-87d9-40ef-a2d3-94544396aa92 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:59:00.553645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-518d3bf3-87d9-40ef-a2d3-94544396aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:59:00.561177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 744/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:59:00.601547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84004f19-c669-401a-8af5-e7dda0a727e3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:59:00.611939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84004f19-c669-401a-8af5-e7dda0a727e3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:59:00.615459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:59:00.616075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:00.616352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:00.616623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:00.625386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:59:00.626824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7181d-60da-4815-a86f-c52130438b55 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:59:00.637527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 749/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 05:59:03.362478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde83d6-46ab-4c39-9ef7-cb377d999bee None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:03.363606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde83d6-46ab-4c39-9ef7-cb377d999bee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:03.363710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde83d6-46ab-4c39-9ef7-cb377d999bee None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:03.365536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 745/1494] 10.222.0.26 () {54 vars in 926 bytes} [Tue Aug 23 05:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 05:59:03.370966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab391ca-481a-4bfe-b849-b7ef01ddf068 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:03.371384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab391ca-481a-4bfe-b849-b7ef01ddf068 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:03.371521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab391ca-481a-4bfe-b849-b7ef01ddf068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:03.389292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0ab391ca-481a-4bfe-b849-b7ef01ddf068 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 05:59:03.390527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0ab391ca-481a-4bfe-b849-b7ef01ddf068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 05:59:03.398260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 750/1495] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Aug 23 05:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 05:59:03.438056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde83d6-46ab-4c39-9ef7-cb377d999bee None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 05:59:03.448575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde83d6-46ab-4c39-9ef7-cb377d999bee None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 05:59:03.451995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 05:59:03.452624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 05:59:03.452903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 05:59:03.453172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 05:59:03.461769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 05:59:03.463200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535ac9f-834b-4ffc-bbb2-a57b7dad657e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 05:59:03.472168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 746/1496] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 05:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:00:30.317777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.318296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.318400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.336302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:00:30.337560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:30.345942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 751/1497] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:00:30.368532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.369012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.369113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.387988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:00:30.389182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:30.396885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 747/1498] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:00:30.401518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.411452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772dc2-8b83-4f0f-8ff9-e8d1aa4dd208 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.415902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.416540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.416824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.417100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.417851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:00:30.418156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.419175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.419175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:00:30.419175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:00:30.420052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.432099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 752/1499] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:00:30.440364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.450209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f344408-098a-4f5f-a2db-b8d60aa4eb0a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.455037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.455683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.455964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.456266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.456960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.458011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.458011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:00:30.458011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:00:30.459224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.579951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 748/1500] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:00:30 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:00:30.584306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.594500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a9b2-66b2-4f5c-a686-905e71e13f19 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.652397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.653050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.653327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.653654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.654323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.655329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.655329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:00:30.655329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:00:30.657164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.761491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 753/1501] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:00:30 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:00:30.766113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.776139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abb2a5-45a5-406b-bf80-ef3dfe64f9c7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.780696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.782011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.782293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.782561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.783279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.784285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.784285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:00:30.784285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:00:30.785163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.799032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 749/1502] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:00:30.803863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.813646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b446751-d2eb-45f6-afa4-d6d2e2ce03ec admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.818167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.818806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.819086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.819363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.820081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.821082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.821082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:00:30.821082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:00:30.821994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e8cce-1bf5-4df8-b5d1-a84eb2d206ab admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.835493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 754/1503] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:00:30.839511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:30.850151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d447-99ba-4950-9d75-e0fba5e363f1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:30.854838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:30.855701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.855978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.856248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] PATH_INFO: `/v3/projects/1967eafd709f4810b43ab8d5c9644978/users/d4838fe6865a4d69b46712ac4164499b/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.870504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1967eafd709f4810b43ab8d5c9644978, user_id=d4838fe6865a4d69b46712ac4164499b, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:30.871561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:30.871561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:00:30.871561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:00:30.873523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c8f6-b7b5-4253-925c-0564ea683c70 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:30.958527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 750/1504] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:00:30 2022] PUT /identity/v3/projects/1967eafd709f4810b43ab8d5c9644978/users/d4838fe6865a4d69b46712ac4164499b/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:00:30.970446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c849e-74db-4148-872a-35acd0805d6d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:30.970740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c849e-74db-4148-872a-35acd0805d6d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:30.971016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c849e-74db-4148-872a-35acd0805d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:30.997622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2a7c849e-74db-4148-872a-35acd0805d6d None None] MFA Rules not processed for user `d4838fe6865a4d69b46712ac4164499b`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:00:30.998964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a7c849e-74db-4148-872a-35acd0805d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:31.061723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 755/1505] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:00:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:00:31.075242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6633c6-7201-472c-a715-db5340797ec4 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.075526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6633c6-7201-472c-a715-db5340797ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.075799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6633c6-7201-472c-a715-db5340797ec4 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.077613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 751/1506] 10.222.0.26 () {54 vars in 961 bytes} [Tue Aug 23 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:00:31.083052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb0b84-34f5-426a-9756-463761229497 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.083369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb0b84-34f5-426a-9756-463761229497 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.083644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb0b84-34f5-426a-9756-463761229497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.101334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0bfb0b84-34f5-426a-9756-463761229497 None None] MFA Rules not processed for user `0b52b24c45b04205922a4394f8eddea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:00:31.102483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0bfb0b84-34f5-426a-9756-463761229497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:31.150641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 756/1507] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Aug 23 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:00:31.160298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6633c6-7201-472c-a715-db5340797ec4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:31.170657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6633c6-7201-472c-a715-db5340797ec4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:31.174143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:31.174792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.175074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.175350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.183311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:31.184758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:31.193866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 752/1508] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:00:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:00:31.237992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ac66-9cb6-4095-ba69-320b472295a3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.238280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ac66-9cb6-4095-ba69-320b472295a3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.238555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ac66-9cb6-4095-ba69-320b472295a3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.240243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 757/1509] 10.222.0.26 () {52 vars in 830 bytes} [Tue Aug 23 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:00:31.243994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:31.302853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b3b20-de0f-4a56-8fbc-8e21c4cd79a4 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:31.307322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:31.308224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.308528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.308799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] PATH_INFO: `/v3/users/d4838fe6865a4d69b46712ac4164499b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.309983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4838fe6865a4d69b46712ac4164499b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:31.310998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:31.310998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:00:31.310998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:00:31.312197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:31.558048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4838fe6865a4d69b46712ac4164499b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:31.609824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4838fe6865a4d69b46712ac4164499b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:31.628527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4838fe6865a4d69b46712ac4164499b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:31.629177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4838fe6865a4d69b46712ac4164499b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:31.629889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4838fe6865a4d69b46712ac4164499b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:31.646994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 753/1510] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:00:31 2022] DELETE /identity/v3/users/d4838fe6865a4d69b46712ac4164499b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:00:31.651269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.651712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.651822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.668513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:00:31.669739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:31.728194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 758/1511] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:00:31.739558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:31.740938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:31.794963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc889-5578-4229-87c5-33e91850e983 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:31.799156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:31.799787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:31.800067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:31.800337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:31.808951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:31.810410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c78b4-2cc5-4d99-a290-62f50a63a1ae service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:31.819414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 754/1512] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:00:32.233851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:00:32.235249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:00:32.247388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f5063-4aa4-4470-b72a-f3e9a1f98bea None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:00:32.252171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:00:32.254252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:00:32.254252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:00:32.254252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] PATH_INFO: `/v3/projects/1967eafd709f4810b43ab8d5c9644978` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:00:32.254844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1967eafd709f4810b43ab8d5c9644978)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:00:32.255863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:00:32.255863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:00:32.255863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:00:32.257152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:00:32.391816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1967eafd709f4810b43ab8d5c9644978', 'request_id': 'req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:32.404866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1967eafd709f4810b43ab8d5c9644978', 'request_id': 'req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:32.411429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1967eafd709f4810b43ab8d5c9644978', 'request_id': 'req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:32.470139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] The token cache is being invalidate because project 1967eafd709f4810b43ab8d5c9644978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:00:32.470429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:32.471050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e2f6d3f-a82b-4c0d-8e00-f53fcb2bc866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:00:32.472673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 759/1513] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:00:32 2022] DELETE /identity/v3/projects/1967eafd709f4810b43ab8d5c9644978 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:02:04.940014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:04.940614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:04.940614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:04.942390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 06:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 06:02:04.947144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46f5f-65b4-4c2e-9605-8997ff4eedf5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:04.947578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46f5f-65b4-4c2e-9605-8997ff4eedf5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:04.947735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46f5f-65b4-4c2e-9605-8997ff4eedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:04.966073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-59d46f5f-65b4-4c2e-9605-8997ff4eedf5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:04.967241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-59d46f5f-65b4-4c2e-9605-8997ff4eedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:05.022515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 06:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:05.172983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:05.174741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:05.246995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9401d2-02ab-4594-a3fb-d0c820a47325 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:05.252926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:05.253593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:05.253873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:05.254145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:05.262291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:05.264024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9feeef-651e-480e-99ac-e23d3a985fc4 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:05.273463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 756/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:06.447865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885ee1-2c8a-40e6-ac9f-1d8eeff3fd10 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:06.448388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885ee1-2c8a-40e6-ac9f-1d8eeff3fd10 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:06.448504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91885ee1-2c8a-40e6-ac9f-1d8eeff3fd10 None None] PATH_INFO: `/v3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:06.449758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 761/1517] 10.222.0.16 () {54 vars in 925 bytes} [Tue Aug 23 06:02:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:02:06.455832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7872dc-b3b1-4202-a62e-007eed299cb1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:06.456297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7872dc-b3b1-4202-a62e-007eed299cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:06.456406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7872dc-b3b1-4202-a62e-007eed299cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:06.474934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ab7872dc-b3b1-4202-a62e-007eed299cb1 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:06.476119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ab7872dc-b3b1-4202-a62e-007eed299cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:06.537376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 757/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 23 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:06.590485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239350-1b50-4f0a-95c7-e831b6189a03 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:06.590773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239350-1b50-4f0a-95c7-e831b6189a03 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:06.591046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d239350-1b50-4f0a-95c7-e831b6189a03 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:06.592910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 762/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 06:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:06.598661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a412a-a0e5-423c-9bf5-a8879ce3c941 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:06.598946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a412a-a0e5-423c-9bf5-a8879ce3c941 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:06.599218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a412a-a0e5-423c-9bf5-a8879ce3c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:06.618876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d14a412a-a0e5-423c-9bf5-a8879ce3c941 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:06.620050 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d14a412a-a0e5-423c-9bf5-a8879ce3c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:06.627615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 758/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:06.778428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d239350-1b50-4f0a-95c7-e831b6189a03 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:06.792895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d239350-1b50-4f0a-95c7-e831b6189a03 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:06.798637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:06.799273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:06.799556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:06.799831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:06.808010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:06.809624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ced1-0af1-497a-b4cb-a80089f040c7 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:06.818765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 763/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:10.905843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53870b-9f68-4c86-a8d3-0d05109eb642 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:10.906431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53870b-9f68-4c86-a8d3-0d05109eb642 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:10.906431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53870b-9f68-4c86-a8d3-0d05109eb642 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:10.908158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 759/1522] 10.222.0.26 () {54 vars in 960 bytes} [Tue Aug 23 06:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:10.913147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3c3e-02cd-4b90-958a-809908515c13 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:10.913606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3c3e-02cd-4b90-958a-809908515c13 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:10.913709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3c3e-02cd-4b90-958a-809908515c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:10.932193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5ccb3c3e-02cd-4b90-958a-809908515c13 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:10.933397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5ccb3c3e-02cd-4b90-958a-809908515c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:10.941763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 764/1523] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Aug 23 06:02:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:10.948930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53870b-9f68-4c86-a8d3-0d05109eb642 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:10.961728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53870b-9f68-4c86-a8d3-0d05109eb642 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:10.966548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:10.967163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:10.967442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:10.967717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:10.976187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:10.977807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b0bb8-e5f0-4d21-a38a-bc4d96a62a95 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:10.987731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 760/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:18.552093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dae25-5439-4ba3-9923-e136316ad731 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:18.552628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dae25-5439-4ba3-9923-e136316ad731 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:18.552628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dae25-5439-4ba3-9923-e136316ad731 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:18.554397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 06:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:18.559541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2c34-de94-4a98-b56e-c2f645a644a6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:18.559970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2c34-de94-4a98-b56e-c2f645a644a6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:18.560075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2c34-de94-4a98-b56e-c2f645a644a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:18.578403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-34ca2c34-de94-4a98-b56e-c2f645a644a6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:18.579610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-34ca2c34-de94-4a98-b56e-c2f645a644a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:18.587134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 06:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:18.739971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dae25-5439-4ba3-9923-e136316ad731 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:18.754256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dae25-5439-4ba3-9923-e136316ad731 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:18.759514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:18.760128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:18.760406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:18.760677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:18.769030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:18.770694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693fb70-a7d1-49d7-b239-c3db63b1cee8 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:18.779704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 766/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:20.082059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f788c-8569-4800-9fb3-c1fb919d870e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:20.082672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f788c-8569-4800-9fb3-c1fb919d870e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:20.082672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f788c-8569-4800-9fb3-c1fb919d870e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:20.084409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 06:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:20.089368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2498f-0a89-4b6e-ac70-4d8dcdff8203 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:20.089799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2498f-0a89-4b6e-ac70-4d8dcdff8203 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:20.089963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2498f-0a89-4b6e-ac70-4d8dcdff8203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:20.108203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-65b2498f-0a89-4b6e-ac70-4d8dcdff8203 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:20.109369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-65b2498f-0a89-4b6e-ac70-4d8dcdff8203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:20.117227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 06:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:20.267843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f788c-8569-4800-9fb3-c1fb919d870e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:20.281848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f788c-8569-4800-9fb3-c1fb919d870e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:20.287110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:20.287730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:20.288005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:20.288276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:20.296572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:20.298193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20f1a8-16d6-40e2-9711-2dee252c896a service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:20.307109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 763/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:24.490808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:24.491343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:24.491343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:24.493127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 06:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:24.498524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea41b-d03e-49a0-b865-3ee5f2b94239 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:24.498952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea41b-d03e-49a0-b865-3ee5f2b94239 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:24.499140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaea41b-d03e-49a0-b865-3ee5f2b94239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:24.517414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6aaea41b-d03e-49a0-b865-3ee5f2b94239 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:24.518706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6aaea41b-d03e-49a0-b865-3ee5f2b94239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:24.526299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:24.563536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:24.565240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:24.619848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae5ece-6afd-48af-a6fd-eeeb87d21aed None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:24.623306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:24.623931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:24.624211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:24.624493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:24.633004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:24.634504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d1c7d-048f-401b-aa40-aa97a585cf60 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:24.644014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 769/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:26.938054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f433-cd48-4a17-a273-1cde883f620c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:26.938579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f433-cd48-4a17-a273-1cde883f620c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:26.938687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f433-cd48-4a17-a273-1cde883f620c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:26.940427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 06:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:26.946398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358c96-5bd5-4819-80ce-95a359778f75 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:26.946818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358c96-5bd5-4819-80ce-95a359778f75 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:26.946952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358c96-5bd5-4819-80ce-95a359778f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:26.966005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ac358c96-5bd5-4819-80ce-95a359778f75 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:26.967825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ac358c96-5bd5-4819-80ce-95a359778f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:26.975461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:27.010883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f433-cd48-4a17-a273-1cde883f620c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:27.021984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f433-cd48-4a17-a273-1cde883f620c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:27.025621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:27.026250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:27.026533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:27.026809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:27.036564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:27.038054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ad4da-9fa9-402e-847b-b79b917bdeb3 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:27.047469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 766/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:02:30.860520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:30.861088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:30.861088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:30.862925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 06:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:30.868601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e2c-049d-4eb1-acdb-9cb14af989b6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:30.869008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e2c-049d-4eb1-acdb-9cb14af989b6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:30.869152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e2c-049d-4eb1-acdb-9cb14af989b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:30.887263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9d6b8e2c-049d-4eb1-acdb-9cb14af989b6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:30.889063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9d6b8e2c-049d-4eb1-acdb-9cb14af989b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:30.896753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 06:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:31.152684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:31.154347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:31.208842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac55e20-293d-43a7-b8f1-d464e1de6b63 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:31.212319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:31.212941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:31.213218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:31.213517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:31.222073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:31.223498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6473f-17d8-42a7-aeeb-19fd2a57e79c service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:31.232970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 772/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:02:33.580763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:33.583876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:33.583876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:33.583876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 768/1540] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 23 06:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:02:33.588324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac5f2-a955-4423-96f1-3f71c041dead None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:33.588762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac5f2-a955-4423-96f1-3f71c041dead None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:33.588870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac5f2-a955-4423-96f1-3f71c041dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:33.607382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9d1ac5f2-a955-4423-96f1-3f71c041dead None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:02:33.608559 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9d1ac5f2-a955-4423-96f1-3f71c041dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:33.616434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 773/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 23 06:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:02:33.867392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:02:33.869151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:02:33.882462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad337-b0af-4600-8a25-7602c5a8001d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:02:33.885917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:02:33.886544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:02:33.886825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:02:33.887100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:02:33.895615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:02:33.897033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2398d2-8cba-438e-9516-585227955b6e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:02:33.906672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 769/1542] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:17.589632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2bea-f1c7-4588-80ce-515ec6e65d16 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.590256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2bea-f1c7-4588-80ce-515ec6e65d16 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.590256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef2bea-f1c7-4588-80ce-515ec6e65d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.591827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51aef4-d48c-4104-a6e8-bd9c78dc603d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.592340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51aef4-d48c-4104-a6e8-bd9c78dc603d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.592449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51aef4-d48c-4104-a6e8-bd9c78dc603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.625205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bf51aef4-d48c-4104-a6e8-bd9c78dc603d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.626556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bf51aef4-d48c-4104-a6e8-bd9c78dc603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.627644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-05ef2bea-f1c7-4588-80ce-515ec6e65d16 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.628844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-05ef2bea-f1c7-4588-80ce-515ec6e65d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.644711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 774/1544] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:17.644906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 770/1544] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:17.650477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369d63-a924-4da4-9c87-e38ed620fd83 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.650765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369d63-a924-4da4-9c87-e38ed620fd83 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.651045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27369d63-a924-4da4-9c87-e38ed620fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.654368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd278e7f-34f3-44cf-b070-5a402fec92d4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.654655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd278e7f-34f3-44cf-b070-5a402fec92d4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.654935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd278e7f-34f3-44cf-b070-5a402fec92d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.676722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-27369d63-a924-4da4-9c87-e38ed620fd83 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.678005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-27369d63-a924-4da4-9c87-e38ed620fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.682053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bd278e7f-34f3-44cf-b070-5a402fec92d4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.684259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bd278e7f-34f3-44cf-b070-5a402fec92d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.693547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 775/1545] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:17.695033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.695319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.695594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.702583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 771/1546] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:17.704058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.704334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.704587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.736533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.739231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.744021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:17.745221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:17.754355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 776/1547] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:17.755203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:17.768083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 772/1548] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:17.768760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:17.775729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5095e7-7d38-476b-a52c-93183a5be801 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:17.787579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1edd7-3206-46b5-8112-7bdb56870fbd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:17.788167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:17.789120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.789415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.789714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.790450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:17.790788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:17.792966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:17.800048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:17.800724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.801003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.801277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.802042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:17.802345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:17.803373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:17.803373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:04:17.803373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:04:17.804298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:17.805998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 777/1549] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:17.806694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:17.819056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3c3c-d777-49b4-97cf-6b3a3b10bd7b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:17.823993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:17.824656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.824941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.825219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.825966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:17.826273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:17.827938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:17.828061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 773/1550] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:17.828974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:17.849209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9772-e4b6-4596-b9de-e14a442c9106 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:17.850133 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 778/1551] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:17.850968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:17.859129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:17.859935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.860219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.860489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.861180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:17.863393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37853b43-990d-41d8-a9f4-096f5f5f50de admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:17.870958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879428b-88d9-4195-8a8b-92886e2244e9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:17.879814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:17.880492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:17.880777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:17.881057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:17.882598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:17.883616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:17.883616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:04:17.883616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:04:17.884823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.052004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 774/1552] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.056542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759678-74b3-4d6e-bd4d-c7320a2c2452 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.056830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759678-74b3-4d6e-bd4d-c7320a2c2452 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.057111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759678-74b3-4d6e-bd4d-c7320a2c2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.074157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0c759678-74b3-4d6e-bd4d-c7320a2c2452 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.075348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0c759678-74b3-4d6e-bd4d-c7320a2c2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.086807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 779/1553] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:17 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:04:18.088671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.133608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 775/1554] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.134885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cc3c-7bd6-4400-8870-32c0164f9ff1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.135177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cc3c-7bd6-4400-8870-32c0164f9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.135496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cc3c-7bd6-4400-8870-32c0164f9ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.148747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254134-3b04-4eef-9925-9d8495681e91 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.154076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.155446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.155446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.155655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2547cc3c-7bd6-4400-8870-32c0164f9ff1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.155759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.156155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.156486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2547cc3c-7bd6-4400-8870-32c0164f9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.158322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.164281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 776/1555] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.165528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6eb03-5760-4d26-92ac-ecd5f80a4329 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.165810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6eb03-5760-4d26-92ac-ecd5f80a4329 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.166084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6eb03-5760-4d26-92ac-ecd5f80a4329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.183926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e6a6eb03-5760-4d26-92ac-ecd5f80a4329 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.185098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6a6eb03-5760-4d26-92ac-ecd5f80a4329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.193045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 777/1556] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.194254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72334e8-6481-42bc-9ea3-998ac0d0f95c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.194540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72334e8-6481-42bc-9ea3-998ac0d0f95c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.194816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72334e8-6481-42bc-9ea3-998ac0d0f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.211660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d72334e8-6481-42bc-9ea3-998ac0d0f95c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.212968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d72334e8-6481-42bc-9ea3-998ac0d0f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.221023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 778/1557] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.222195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.222476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.222749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.241462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.242637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.250437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 779/1558] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.251929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.261024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e264335-c21a-4390-9071-e38da29cd33e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.265629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.266268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.266545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.266815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.267485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.268505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:18.268505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:04:18.268505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:04:18.270314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 780/1559] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.278648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0e3db-02a1-4c0a-b1fc-13b5b284702d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.278782 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.330835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671178ca-57b5-46a1-b493-4cabf43d12a5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.335321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.336009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.336290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.337059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.337221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.343157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384cba4-393b-4b36-9a6c-a9f4ef3a4bd5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.365640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 780/1560] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.366931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933530-6f70-4b03-a9e2-c4f93dd25ef5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.367216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933530-6f70-4b03-a9e2-c4f93dd25ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.367492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933530-6f70-4b03-a9e2-c4f93dd25ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.384747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d933530-6f70-4b03-a9e2-c4f93dd25ef5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.386488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d933530-6f70-4b03-a9e2-c4f93dd25ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.394180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 781/1561] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.396426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f0c5-9509-4441-a512-887276256e2d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.396426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f0c5-9509-4441-a512-887276256e2d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.396426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7f0c5-9509-4441-a512-887276256e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.413581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bfd7f0c5-9509-4441-a512-887276256e2d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.414831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bfd7f0c5-9509-4441-a512-887276256e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.422639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 782/1562] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.428256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ecd0-e9e7-41a3-b6b9-88e4e2b0b7ef None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.428256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ecd0-e9e7-41a3-b6b9-88e4e2b0b7ef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.428256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ecd0-e9e7-41a3-b6b9-88e4e2b0b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.440896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a445ecd0-e9e7-41a3-b6b9-88e4e2b0b7ef None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.442044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a445ecd0-e9e7-41a3-b6b9-88e4e2b0b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.450241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 783/1563] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.451444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.451732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.452006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.458575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 781/1564] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.462270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298792-2f07-4247-a52a-04947809706a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.462270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298792-2f07-4247-a52a-04947809706a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.462270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298792-2f07-4247-a52a-04947809706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.470494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.471714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.477838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-19298792-2f07-4247-a52a-04947809706a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:18.478998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-19298792-2f07-4247-a52a-04947809706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:18.479625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 784/1565] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.480370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.487010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 782/1566] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:18.490053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96b40c-01d5-4f75-a468-45699237fc95 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.490299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19298792-2f07-4247-a52a-04947809706a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.495289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.495970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.496250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.496528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.497332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.499262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.499732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19298792-2f07-4247-a52a-04947809706a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.504402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.505098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.508135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.508135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.508135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.508135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.518561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 783/1567] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:18.519367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.529033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51232-00de-4d32-8ca1-1fddb663adb7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.533635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.534243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.534523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.534795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.535522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:18.535828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.537402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.548698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 784/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:18.549474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.558321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f225077-7763-4b8f-beff-a7e2cb6fb59c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.562753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.563341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.563619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.563888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.564565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:18.564863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.566424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.577997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 785/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:18.578880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.588751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e432-4f8a-4829-9e3b-f1189b0e9649 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.593888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.594482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.594743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.595011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.595689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:18.595987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.597635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.608910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 786/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:18.617220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.620803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 785/1571] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.620803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.621457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acc4f9-b82b-4280-8ef7-27a2c4e4287e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.624301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.624929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.625207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.625504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.626208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.627839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.628138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97735c1-53d1-43ad-84dd-fbbd2314b738 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.632584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.633218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.633526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.633806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.634522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:18.634825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.636923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.638534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 787/1572] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:18.639331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.648963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e626e-209c-4e28-893c-805aa865146a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.654262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.654909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.655196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.655488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.656196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:18.656502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.658120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.658947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 786/1573] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:18.660098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.669390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186f9ed-ec31-4141-8049-3188adb0013a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.669938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 788/1574] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:18.670706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.675811 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.676543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.676955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.677236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.677988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.679631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.680987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2966-9a69-4ec8-b19f-c2e8405cddd1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.685634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.686262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.686545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.686820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.687521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.692650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 787/1575] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:18.692811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.692919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.701595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269962c-366f-418b-bc30-50728de67ad9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.706545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.707159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.707435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.707709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.708369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.710265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.800889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 789/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.801720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.827207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 788/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/projects => generated 401 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:18.827207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.861299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef273b9b-8844-4058-9e1c-5d11095a3200 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.884847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffaeee-60fd-4836-a11a-20bca6d97a21 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.890076 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.890729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.891011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.891289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.892010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.893643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.903180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 789/1578] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:18.903969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.913202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba46b-3c11-455b-a2ae-0cca1ff94183 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.917686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.918301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.918580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.918874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.919566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.919816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.920473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.920755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.921031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.921145 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.921743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.923665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:18.930775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 790/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:18.931542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:18.941912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff73b-d211-4aef-b24b-8e7bfac53c6e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:18.946473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:18.952505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:18.952505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:18.952505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:18.952505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:18.952505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.017986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 790/1580] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.018957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.043522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 791/1581] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:18 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.043522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.078491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc65488-09f9-4bd8-83fa-5ccc3f10a61e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.101932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0b81-26f5-4257-9994-6246debce92c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.106963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.107830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.108107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.108378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] PATH_INFO: `/v3/projects/971c5b3f52424429938eab4f27b2fa70/users/bed66fca3e884b1187261ed5af115a61/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.122886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971c5b3f52424429938eab4f27b2fa70, user_id=bed66fca3e884b1187261ed5af115a61, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.125499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.132001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.132651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.132930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.133204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.133924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.135824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.221158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 792/1582] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:19 2022] PUT /identity/v3/projects/971c5b3f52424429938eab4f27b2fa70/users/bed66fca3e884b1187261ed5af115a61/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:19.222042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.247987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 791/1583] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.247987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.281681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8993c8-f429-40a3-9219-a3e919ee5fe0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.305517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa37053-5dac-4ff6-8e26-9f1a99ea86ec admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.310619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.311274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.311552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.311828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.312501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.314452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.336677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.337380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.337685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.337965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.338640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.340609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.428578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 792/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.429587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.439568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9a2fe-5f87-4c71-99ec-d863ad5e5000 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.444013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.444633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.444905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.445175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.445925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.447501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.457033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 793/1585] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:19.457926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.466914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43324b7-9f93-4674-a870-a015e84959ef admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.468100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 793/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.468836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.472419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.475053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.475053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.475053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] PATH_INFO: `/v3/projects/b46a240be5e84bd7bde99fc7a8628b61/users/d2bd1b793a33487b834c4684b7c31231/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.481698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafb90-a8df-40b3-bac5-719dbe20889f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.486309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.486954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.487234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.487537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.488498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.489732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a240be5e84bd7bde99fc7a8628b61, user_id=d2bd1b793a33487b834c4684b7c31231, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.490458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5df5-14f4-40cc-beed-78ef66931d80 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.490870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:19.490870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:04:19.490870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:04:19.493016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.588427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 794/1587] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:19 2022] PUT /identity/v3/projects/b46a240be5e84bd7bde99fc7a8628b61/users/d2bd1b793a33487b834c4684b7c31231/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:19.589902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.628756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 794/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.635609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.635609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.635609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.648640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b2f0d-ea75-43f6-8af2-bc065713208c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.653799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.654463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.654742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.655018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.655702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.657148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] MFA Rules not processed for user `bed66fca3e884b1187261ed5af115a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:19.657631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.658467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:19.718880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 795/1589] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:19.719821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.729565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50376-64d4-419e-b6b2-24d3a965af11 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.734428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.735051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.735328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.735597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.736260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.738503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.777130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 795/1590] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.778124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.787246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded686cc-b84f-483e-b0d7-24a7d1645aed admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.792640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.793375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.793694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.793979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.794687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.796306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.806204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 796/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:19.806934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.816262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342b99d-22b9-4bf4-9590-695864adc909 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.820810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.821717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.821993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.822264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] PATH_INFO: `/v3/projects/41de49d1e830476fa45c59ed69f8b7c2/users/ceb7b426bbef4637890ee6e203aee9fc/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.836037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41de49d1e830476fa45c59ed69f8b7c2, user_id=ceb7b426bbef4637890ee6e203aee9fc, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.838650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.868381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 796/1592] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:19.873781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.878445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a04f7-3769-4c20-ab11-a68a6fadda23 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.882893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.883511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.883791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.884094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.884803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.886987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c49b8-9255-4643-b1b2-05f2f6522dce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.896899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 797/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:19.898106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.898386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.898655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.915734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:19.917028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:19.924419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 798/1594] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:19.925174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.930828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 797/1595] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:19 2022] PUT /identity/v3/projects/41de49d1e830476fa45c59ed69f8b7c2/users/ceb7b426bbef4637890ee6e203aee9fc/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:19.936907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:19.937016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ebd64-7389-4b01-93b9-cb38a69aacf7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.987517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.988433 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:19.988708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:19.988976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:19.989714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:19.991305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:19.994511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622e1e-c9c0-433b-b411-911e2197ad3d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:19.999238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:19.999884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.000173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.000450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.000858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 799/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.001134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.001667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.003086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.010545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7904c-ea4f-46d9-8eeb-5e6b41b8fdce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.015591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.016213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.016491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.016760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.017484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.019048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.032296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 800/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.034174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.043074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57f1-32a1-4ceb-913a-2a732e7fe1a4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.047587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.048185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.048463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.048736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.049485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.051017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.062414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 801/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.062414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.072074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 798/1599] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:19 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:20.072074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.073014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6adcd-9281-40c2-87b3-82dac96784df admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.127400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.128513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.128513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.128720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.129310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.130973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0d5e9-7037-4cba-98fc-7483f69bf1a5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.131746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd629e-fd6c-4fc2-b303-2091b4c22793 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.136709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.137457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.137694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.137966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.138674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.140249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.141246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 802/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.142325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.142611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.142890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.150800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 799/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.152576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.163526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:20.164700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:20.172205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 803/1602] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:20.175439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.184010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb750a56-a9c0-479a-8b28-9501322c4554 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.188503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.189139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.189416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.189722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.190440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.192053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.202394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 804/1603] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.203179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.205668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24048-e641-416b-8861-4c23ab03cab8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.209068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.209746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.210036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.210330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.212164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc54-f52e-49fd-971d-186f2fa42d8e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.217133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.217788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.218068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.218341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.219033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.219842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.220571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.221272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.229924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 805/1604] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.233367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 800/1605] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:20.233498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.233595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.240026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490f6f-2a3f-4fcd-b9c5-9d58876316b2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.242438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253afce5-fc8c-4d10-927d-5ec5407e7df4 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.244950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.246734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.247017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.247380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] PATH_INFO: `/v3/projects/3a01a872d04245e085073b5d62333b65/users/f4084d8a730048f8a927adfc8c00db36/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.248073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.248467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.248725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.249002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.249742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.251657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.263803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a01a872d04245e085073b5d62333b65, user_id=f4084d8a730048f8a927adfc8c00db36, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.266574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.377991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 801/1606] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:20.378217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 806/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:20 2022] PUT /identity/v3/projects/3a01a872d04245e085073b5d62333b65/users/f4084d8a730048f8a927adfc8c00db36/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:20.378334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.378445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.390759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b7a0-9a3e-4273-9ad5-d0cce3f5df51 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.442486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3e5e-c4b3-4a32-8685-91ff627d2689 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.447724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.449496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.449814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.450155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.450295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] PATH_INFO: `/v3/projects/cdcc94a5ac0246afb333e33541f5ac2b/users/e7b48227a0dd443996039fdd00ad95b8/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.450858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.451139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.451415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.452182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.454427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.464614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 802/1608] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.466029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.470884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcc94a5ac0246afb333e33541f5ac2b, user_id=e7b48227a0dd443996039fdd00ad95b8, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.473877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.523379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f756-51fc-4bdf-af2e-8e9f1f7fb3b3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.527028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.527662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.527941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.528212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.537273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.538716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.548690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 803/1609] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:20.549498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.558931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb6ed6-3380-462e-bd15-66e38ba5d9f2 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.563617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.564482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.568969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.568969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] PATH_INFO: `/v3/projects/3b3e1025e9e341288628ebd4cc27ee0b/users/5da7b83099bd49de9d254d8338f587e7/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.569208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 807/1610] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:20 2022] PUT /identity/v3/projects/cdcc94a5ac0246afb333e33541f5ac2b/users/e7b48227a0dd443996039fdd00ad95b8/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:20.569208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.583239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3e1025e9e341288628ebd4cc27ee0b, user_id=5da7b83099bd49de9d254d8338f587e7, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.585939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9517dcc-6c0e-49aa-af2a-a788abd8fe99 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.635551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14645-3715-4c81-bf8f-a49dac983500 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.640306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.641245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.641511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.641790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] PATH_INFO: `/v3/projects/8149140f47e447fd92f7101559b3f0d3/users/a3b54fb538d04a2f8be2cb3c88f38d7d/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.657283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8149140f47e447fd92f7101559b3f0d3, user_id=a3b54fb538d04a2f8be2cb3c88f38d7d, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.660001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.720247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 804/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:20 2022] PUT /identity/v3/projects/3b3e1025e9e341288628ebd4cc27ee0b/users/5da7b83099bd49de9d254d8338f587e7/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:20.721563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.721921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.722530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.745082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:20.747076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:20.749910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 808/1612] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:20 2022] PUT /identity/v3/projects/8149140f47e447fd92f7101559b3f0d3/users/a3b54fb538d04a2f8be2cb3c88f38d7d/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:20.754990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.817354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 805/1613] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:20.817354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.817656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130189-8e6b-4074-95a0-1722870f0f73 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.822255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.823307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.823740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.824972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.825902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.827734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b5342-2888-438f-a8eb-b325409776c6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.832491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8e41-aff1-4b94-95bc-4d1c0110f8be None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:20.839020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:20.839779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 809/1614] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:20.841098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b55f-1009-46f2-8fe1-2215a031e0f8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.841528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b55f-1009-46f2-8fe1-2215a031e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.841873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b55f-1009-46f2-8fe1-2215a031e0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.843304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.843555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.844087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] PATH_INFO: `/v3/projects/fdd86f8650a9453bb06500b0b0aa31e7/users/45f516e419574132b8760971af6146c5/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.860873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd86f8650a9453bb06500b0b0aa31e7, user_id=45f516e419574132b8760971af6146c5, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:20.861776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6895b55f-1009-46f2-8fe1-2215a031e0f8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:20.863241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6895b55f-1009-46f2-8fe1-2215a031e0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:20.864615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce36dd-f490-4d9b-b044-e9d3e8c70c34 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:20.871868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 810/1615] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:20.873206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.873751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.873751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.908848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] MFA Rules not processed for user `5da7b83099bd49de9d254d8338f587e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:20.910087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:20.971654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 806/1616] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:20 2022] PUT /identity/v3/projects/fdd86f8650a9453bb06500b0b0aa31e7/users/45f516e419574132b8760971af6146c5/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:20.973005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:20.979238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:20.979238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:20.990733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 811/1617] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:20.990733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:20.990733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:20.996148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:20.997572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:21.050441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff8d4-7081-4184-911a-2eebb737bd5e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.056557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 807/1618] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:21.057197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.069285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b4c8a-a11f-4193-a5d3-64a77ab1ccd6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.074317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.075197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.075475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.075747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] PATH_INFO: `/v3/projects/9ca0484499b6432eb1f1d15475aba982/users/3ba27eece4d049b3af7d97608387d7f4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.091914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca0484499b6432eb1f1d15475aba982, user_id=3ba27eece4d049b3af7d97608387d7f4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.094894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b65c-e485-4c83-8704-ef476f8c117e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.102767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.103416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.103697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.103971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.115040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.116575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.127144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 812/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.128393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.136270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025cb4c-483c-4a28-b64b-a71e817d4096 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.140704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.141619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.142726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.142726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.152803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.158527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918938-cb59-4cd8-996e-21088955a82a service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.166035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 813/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.168631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.168990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.169335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.186672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 808/1621] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:21 2022] PUT /identity/v3/projects/9ca0484499b6432eb1f1d15475aba982/users/3ba27eece4d049b3af7d97608387d7f4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:21.191949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:21.192913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425965-3cea-4582-aae3-3c8fbddc455c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.193254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:21.193601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425965-3cea-4582-aae3-3c8fbddc455c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.194044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425965-3cea-4582-aae3-3c8fbddc455c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.202780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 809/1622] 10.222.0.26 () {54 vars in 959 bytes} [Tue Aug 23 06:04:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:21.204108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4425965-3cea-4582-aae3-3c8fbddc455c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.267378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4425965-3cea-4582-aae3-3c8fbddc455c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.271686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.272648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.273032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.273409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.277596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 814/1623] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:21.278616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.288586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160221-fde4-4b4a-9f5b-4a72600a01fe None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.289321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.290950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65b8f-0ca0-4f86-8e62-62170ca8b714 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.294869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.295581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.295907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.296263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.296979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.298717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.302354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 810/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.303771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.304177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.304577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.310598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 815/1625] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:21.311302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.321300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac793f-84d6-41f0-9eb8-b9f958419fcd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.325179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:21.325313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.325882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.326217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.326495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.326609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:21.338288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.340381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.362557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 816/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.363658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.387846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7886679-d92a-4931-b43a-aa337249a7a5 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.395508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.397224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.398062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.398602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] PATH_INFO: `/v3/projects/9ca0484499b6432eb1f1d15475aba982/users/3ba27eece4d049b3af7d97608387d7f4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.407819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca0484499b6432eb1f1d15475aba982, user_id=3ba27eece4d049b3af7d97608387d7f4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.407819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79bbd7-23a1-4edd-8cf8-77486a039572 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.417497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 811/1627] 10.222.0.26 () {58 vars in 1056 bytes} [Tue Aug 23 06:04:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:21.419114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 817/1628] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:21 2022] PUT /identity/v3/projects/9ca0484499b6432eb1f1d15475aba982/users/3ba27eece4d049b3af7d97608387d7f4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:21.427628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.431580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.432012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.432464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.446158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f143f-25bc-49e0-93af-d1e77d5dce3c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.470214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] MFA Rules not processed for user `3ba27eece4d049b3af7d97608387d7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:21.471864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:21.547612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.548957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.549247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.549677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.580626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 818/1629] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:21.594958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.633098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.635311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe85f4-1aa4-403c-8ae6-75f3ca25d468 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.648154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 812/1630] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.676373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedacd46-59dd-440f-96fb-8125711452e1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.680931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.681723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.682106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.682513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.694798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:21.697061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44a92d-af05-4484-8310-c690cbaaddd0 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:21.710478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 819/1631] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:21.885382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1006d8-2ba8-4e0d-b688-5efa3e84a58b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.885909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1006d8-2ba8-4e0d-b688-5efa3e84a58b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.888230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1006d8-2ba8-4e0d-b688-5efa3e84a58b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.909449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 813/1632] 10.222.0.26 () {54 vars in 912 bytes} [Tue Aug 23 06:04:21 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:21.917906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.918568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.918839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:21.948815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:21.950804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:21.964604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 820/1633] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:04:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:21.978141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1006d8-2ba8-4e0d-b688-5efa3e84a58b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:21.992034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1006d8-2ba8-4e0d-b688-5efa3e84a58b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:21.996431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:21.997059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:21.998318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:21.998318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:22.009619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:22.011288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059a608-85ba-4244-965c-a8b6b86affb8 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:22.023743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:22.036710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce36f0-465a-49b2-b5fb-73b9dd28a524 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:22.038341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 814/1634] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:22.045956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:22.046687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:22.046972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:22.047928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:22.202841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:22.204875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5cdc-8b8d-4641-92b7-dae43861ebc9 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:22.219225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 821/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:04:24.236053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a445c-9f18-432a-83d5-b6592932f6d9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.236480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a445c-9f18-432a-83d5-b6592932f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.236617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a445c-9f18-432a-83d5-b6592932f6d9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.241128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 815/1636] 10.222.0.26 () {54 vars in 959 bytes} [Tue Aug 23 06:04:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:24.250980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.252012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.252944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.281683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:24.283755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:24.312971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1023-228b-491e-827e-b86cb57035c7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.314044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1023-228b-491e-827e-b86cb57035c7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.322614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1023-228b-491e-827e-b86cb57035c7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.322614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 816/1637] 10.222.0.26 () {54 vars in 912 bytes} [Tue Aug 23 06:04:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 06:04:24.328410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880d5-88cb-4e07-a044-2fd43eb67b8c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.328983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880d5-88cb-4e07-a044-2fd43eb67b8c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.329542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880d5-88cb-4e07-a044-2fd43eb67b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.334530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 822/1638] 10.222.0.26 () {58 vars in 1056 bytes} [Tue Aug 23 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:24.368626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a6e880d5-88cb-4e07-a044-2fd43eb67b8c None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:24.370169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a6e880d5-88cb-4e07-a044-2fd43eb67b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:24.404735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 817/1639] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:24.420971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:24.460001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f38c1-fac2-4268-9c98-faad0c8c41a0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:24.470677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:24.471651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.471976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.472260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.527170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:24.528728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:24.552983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 823/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:24.830649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:24.831244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:24.831699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:24.879843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] MFA Rules not processed for user `f4084d8a730048f8a927adfc8c00db36`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:24.881335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:25.022225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 818/1641] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:25.027673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.101323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802c15-3ba3-4eaf-8215-c307cce5654c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.110014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.111118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.111710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.112294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.113481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.117457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:25.225765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 824/1642] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:25 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:04:25.226943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.240868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7100b-4575-4435-97f6-b1328f1791c0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.360683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.361747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.362374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.363047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.364113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.366523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:25.490645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 819/1643] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:25 2022] POST /identity/v3/users => generated 309 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:25.495370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.516220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a58e-3d35-4f06-a0c3-56d7ddf8b12e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.521428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.522154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.522434 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.523047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.523762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.525389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:25.549897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 825/1644] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:25.554630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.576703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6ce4-592a-44ce-942f-f6f28c58dd4d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.584001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.585090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.585495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.585879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] PATH_INFO: `/v3/projects/258d328cda4b4f5889cb41a21be9db18/users/caf8b6675da14ce1bd4f16d74266ffd4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.619177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258d328cda4b4f5889cb41a21be9db18, user_id=caf8b6675da14ce1bd4f16d74266ffd4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.623372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:25.763792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 820/1645] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:25 2022] PUT /identity/v3/projects/258d328cda4b4f5889cb41a21be9db18/users/caf8b6675da14ce1bd4f16d74266ffd4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:25.767534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.789462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0d425-7e52-4848-80ab-14bd02d42d91 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.901914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.901914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.901914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.901914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.902521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.902521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:25.922484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 826/1646] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:25.926528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:25.968907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff019853-d583-41ee-bab1-0a33475e17b8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:25.985301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:25.986613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:25.986818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:25.987130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] PATH_INFO: `/v3/projects/258d328cda4b4f5889cb41a21be9db18/users/caf8b6675da14ce1bd4f16d74266ffd4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:25.992097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258d328cda4b4f5889cb41a21be9db18, user_id=caf8b6675da14ce1bd4f16d74266ffd4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:25.996272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6c272-f346-4d5d-9dea-21b4f100bf90 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:26.029465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 821/1647] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:25 2022] PUT /identity/v3/projects/258d328cda4b4f5889cb41a21be9db18/users/caf8b6675da14ce1bd4f16d74266ffd4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:27.441415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:27.470911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ce32-1b92-4363-b367-bb756a81cdfb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:27.574289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:27.575613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:27.576043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:27.576688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] PATH_INFO: `/v3/users/5da7b83099bd49de9d254d8338f587e7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:27.578200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da7b83099bd49de9d254d8338f587e7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:27.581029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:27.891350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da7b83099bd49de9d254d8338f587e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:28.010250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da7b83099bd49de9d254d8338f587e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:28.042552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da7b83099bd49de9d254d8338f587e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:28.043696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da7b83099bd49de9d254d8338f587e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:28.059079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da7b83099bd49de9d254d8338f587e7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:28.098981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546713-3f1f-4154-8ba9-0ca964e510f1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:28.099476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546713-3f1f-4154-8ba9-0ca964e510f1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:28.099586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546713-3f1f-4154-8ba9-0ca964e510f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:28.100195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 827/1648] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:27 2022] DELETE /identity/v3/users/5da7b83099bd49de9d254d8338f587e7 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:28.133697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-80546713-3f1f-4154-8ba9-0ca964e510f1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:28.135764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-80546713-3f1f-4154-8ba9-0ca964e510f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:28.388904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 822/1649] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:28.393794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:28.393794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:28.452304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33228dbd-6672-4e8a-8839-49e78905514b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:28.485269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:28.486328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:28.486823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:28.487321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:28.501218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:28.504455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:28.519153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 828/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:30.373103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fa452-f2ab-44f4-b26e-b274e0280bc2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:30.374016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fa452-f2ab-44f4-b26e-b274e0280bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:30.374531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fa452-f2ab-44f4-b26e-b274e0280bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:30.410728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b84fa452-f2ab-44f4-b26e-b274e0280bc2 None None] MFA Rules not processed for user `caf8b6675da14ce1bd4f16d74266ffd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:30.412738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b84fa452-f2ab-44f4-b26e-b274e0280bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:30.494043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 823/1651] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:31.042418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:31.043889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:31.068814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b26d-9468-45d6-95f6-d57b35170093 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:31.087320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:31.088247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:31.088682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] PATH_INFO: `/v3/projects/3b3e1025e9e341288628ebd4cc27ee0b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3e1025e9e341288628ebd4cc27ee0b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: WARNING py.warnings [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: warnings.warn(msg) Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: Aug 23 06:04:31.100092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:31.256263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3e1025e9e341288628ebd4cc27ee0b', 'request_id': 'req-25aa3159-52c7-4efa-a4bb-a5b180fdf611'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:31.290666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3e1025e9e341288628ebd4cc27ee0b', 'request_id': 'req-25aa3159-52c7-4efa-a4bb-a5b180fdf611'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:31.305028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3e1025e9e341288628ebd4cc27ee0b', 'request_id': 'req-25aa3159-52c7-4efa-a4bb-a5b180fdf611'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:31.412959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] The token cache is being invalidate because project 3b3e1025e9e341288628ebd4cc27ee0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:31.414062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:31.416857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-25aa3159-52c7-4efa-a4bb-a5b180fdf611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:31.426745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 829/1652] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:31 2022] DELETE /identity/v3/projects/3b3e1025e9e341288628ebd4cc27ee0b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:04:31.427749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:31.428171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:31.428310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:31.468622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:31.469895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:31.584098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 824/1653] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:31.594342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:31.594631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:31.594931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:31.633252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:31.634523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:31.666766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 830/1654] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:31.667977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:31.680252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c0b8-70c4-465d-a7c5-c8d6b629259a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:31.686615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:31.687598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:31.688077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:31.692118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:31.693147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:31.693656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:31.695880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:31.720132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 825/1655] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:31.724964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:31.740257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b829e62-dea6-4ca7-b636-848ec0d07166 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:31.755332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:31.756316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:31.756632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:31.756897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:31.758195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:31.760779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3f04-e03c-4781-9548-541208b5b942 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:31.961472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 831/1656] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:31 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:31.962698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:31.976240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba147-2fae-409c-9545-53abeb3cf53a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.083918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.084965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.085461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.085936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.086830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.090077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.209841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0661bf-0714-4968-a2d0-ffb88c70bd0b None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.210355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0661bf-0714-4968-a2d0-ffb88c70bd0b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.210451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0661bf-0714-4968-a2d0-ffb88c70bd0b None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.212926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 832/1657] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:32.222400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf70d7e-b807-4baa-a23b-7167e2e2c90c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.222946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf70d7e-b807-4baa-a23b-7167e2e2c90c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.227506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf70d7e-b807-4baa-a23b-7167e2e2c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.227610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 826/1658] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:31 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:32.230110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.248716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9b539-3bcd-47ee-933f-4aed0eb4d3dc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.259421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.262044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.262338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.262620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.265222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.265222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.286722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bcf70d7e-b807-4baa-a23b-7167e2e2c90c None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:32.290076 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcf70d7e-b807-4baa-a23b-7167e2e2c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:32.299223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 827/1659] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:32.303826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.321049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c5bf-9f7f-43d3-bdb0-2f97bb787bd1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.330770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.335284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.335574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.335856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.340753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.347456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.378861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 828/1660] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:32.382682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.411449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d9bdb-ad9f-4db2-8cfc-1437ec76713c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.420732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.425060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.425610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.426207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] PATH_INFO: `/v3/projects/309f96243a924ac580fe63c90d699191/users/3041e2c0ee6a4edcaa4eccfaa27a16b7/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.449702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309f96243a924ac580fe63c90d699191, user_id=3041e2c0ee6a4edcaa4eccfaa27a16b7, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.453076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ed2c-aca7-4fc1-9ddb-db6aea1ffab4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.487364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 833/1661] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:04:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:32.519616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708606f2-156e-4f96-bb90-2828bef3cc5e None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.519954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708606f2-156e-4f96-bb90-2828bef3cc5e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.520240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708606f2-156e-4f96-bb90-2828bef3cc5e None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.522374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 834/1662] 10.222.0.26 () {54 vars in 960 bytes} [Tue Aug 23 06:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 06:04:32.529689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.530077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.530356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.552764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 829/1663] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:32 2022] PUT /identity/v3/projects/309f96243a924ac580fe63c90d699191/users/3041e2c0ee6a4edcaa4eccfaa27a16b7/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:32.563468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.563974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.564418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.593464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:32.597908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:32.624952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] MFA Rules not processed for user `3041e2c0ee6a4edcaa4eccfaa27a16b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:32.626491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:32.733577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 830/1664] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:32.738215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.748560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 835/1665] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Aug 23 06:04:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:32.750219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.771380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6a2cc-ade7-43ed-9e39-90d980b4c00f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.788017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.788905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.790093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.790783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.807648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.814163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.842599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59824ba5-f419-4b16-b03f-e77c1b88f9de None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:32.846933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 836/1666] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:32.855891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:32.857748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:32.857880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:32.858435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:32.858897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:32.861410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:32.973961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 831/1667] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:32 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:32.975294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:32.989096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaf269-efbe-438a-978a-dc2c4aa98a10 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:33.090143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:33.090921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.091263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.091551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.092256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:33.094313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:33.190028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 837/1668] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:32 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:33.194828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:33.210479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64b12c-b9cd-4ec3-a12e-41560337f5cd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:33.228603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:33.228603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.228603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.228603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.230918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:33.235206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:33.267985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:33.269237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 832/1669] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:33.284681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a4809-f43b-40e5-99c5-7e9c440825b0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:33.296640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:33.298093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.298517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.298932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] PATH_INFO: `/v3/projects/951117a43e354814996ab94568c138c6/users/30e91aa11b5c429ca9583fc8ee729f58/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.337736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951117a43e354814996ab94568c138c6, user_id=30e91aa11b5c429ca9583fc8ee729f58, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:33.345363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:33.480573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:33.481912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 838/1670] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:33 2022] PUT /identity/v3/projects/951117a43e354814996ab94568c138c6/users/30e91aa11b5c429ca9583fc8ee729f58/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:33.498687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9e412-1221-4aeb-90f2-092ec6ae5703 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:33.656618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:33.657610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.658034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.658473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.659368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:33.661369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98eec9-25fb-4a49-9a58-3d2243e95708 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:33.688900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 833/1671] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:33.692979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:33.705044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadfb1c-9ae5-4d7a-8929-8c8e66723038 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:33.712117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:33.713212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.714057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.714057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] PATH_INFO: `/v3/projects/951117a43e354814996ab94568c138c6/users/30e91aa11b5c429ca9583fc8ee729f58/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.724107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=951117a43e354814996ab94568c138c6, user_id=30e91aa11b5c429ca9583fc8ee729f58, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:33.727058 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d556418-9ebe-4719-9610-188b809a1d2a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:33.764250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.764542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.764944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 839/1672] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:33 2022] PUT /identity/v3/projects/951117a43e354814996ab94568c138c6/users/30e91aa11b5c429ca9583fc8ee729f58/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:33.777889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.785889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:33.786017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:33.786309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:33.819346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] MFA Rules not processed for user `45f516e419574132b8760971af6146c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:33.827001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:33.863097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] MFA Rules not processed for user `30e91aa11b5c429ca9583fc8ee729f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:33.863097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:34.005188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 834/1673] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:34.051542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:34.054857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:34.085608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 840/1674] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:34.107124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:34.108547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:34.297731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a56319-8ec5-4859-9e57-bc6250159267 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:34.313450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47163c0-cd58-4df4-b2b8-1af32b70637b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:34.314733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:34.315932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:34.316200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:34.316465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:34.325290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:34.326301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:34.326790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:34.327174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:34.338606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:34.340495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:34.341476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:34.342435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:34.357785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 835/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:04:34.374225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 841/1676] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:04:34.621878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:34.623170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:34.850146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937513d-fadb-42cb-abec-f6091378f103 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:34.888806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:34.890127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:34.890127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:34.890275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] PATH_INFO: `/v3/users/f4084d8a730048f8a927adfc8c00db36` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:34.894692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4084d8a730048f8a927adfc8c00db36)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:34.897051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: WARNING py.warnings [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 06:04:34.897051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: warnings.warn(msg) Aug 23 06:04:34.897051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: Aug 23 06:04:34.906272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:35.208031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4084d8a730048f8a927adfc8c00db36'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:35.319875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4084d8a730048f8a927adfc8c00db36'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:35.374032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4084d8a730048f8a927adfc8c00db36'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:35.384896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4084d8a730048f8a927adfc8c00db36'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:35.412015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4084d8a730048f8a927adfc8c00db36'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:35.424345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 836/1677] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:34 2022] DELETE /identity/v3/users/f4084d8a730048f8a927adfc8c00db36 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:35.834090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:35.849800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936fecf-09a7-4bdb-8022-cfbe50eb2a56 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:36.010755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:36.011900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:36.012318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:36.012830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] PATH_INFO: `/v3/users/3041e2c0ee6a4edcaa4eccfaa27a16b7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:36.014594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3041e2c0ee6a4edcaa4eccfaa27a16b7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:36.016763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:36.111072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:36.112881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:36.150924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21671-63c3-46fd-9f63-658d08792ce7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:36.163626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:36.164828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:36.165107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:36.165593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] PATH_INFO: `/v3/projects/3a01a872d04245e085073b5d62333b65` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:36.175622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a01a872d04245e085073b5d62333b65)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:36.176474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:36.348415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3041e2c0ee6a4edcaa4eccfaa27a16b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.374539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a01a872d04245e085073b5d62333b65', 'request_id': 'req-933dbc14-8558-42ca-83ed-f38860f4190a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.386569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a01a872d04245e085073b5d62333b65', 'request_id': 'req-933dbc14-8558-42ca-83ed-f38860f4190a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.395019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a01a872d04245e085073b5d62333b65', 'request_id': 'req-933dbc14-8558-42ca-83ed-f38860f4190a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.427674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3041e2c0ee6a4edcaa4eccfaa27a16b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.452644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3041e2c0ee6a4edcaa4eccfaa27a16b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.454165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3041e2c0ee6a4edcaa4eccfaa27a16b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.458385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-41555146-b3b7-4c1e-869f-276971f0c2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3041e2c0ee6a4edcaa4eccfaa27a16b7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.490345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] The token cache is being invalidate because project 3a01a872d04245e085073b5d62333b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:36.490865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.491911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 842/1678] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:35 2022] DELETE /identity/v3/users/3041e2c0ee6a4edcaa4eccfaa27a16b7 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:36.493391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:36.493711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:36.495095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:36.497956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:36.500498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 837/1679] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:36 2022] DELETE /identity/v3/projects/3a01a872d04245e085073b5d62333b65 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:36.505400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:36.506823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:36.534520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:36.535755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:36.631275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dbc14-8558-42ca-83ed-f38860f4190a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:36.657774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 843/1680] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:36.674022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:36.675571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:36.778797 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:36.779691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:36.779979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:36.780250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] PATH_INFO: `/v3/users/caf8b6675da14ce1bd4f16d74266ffd4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:36.782796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf8b6675da14ce1bd4f16d74266ffd4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:36.784745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:36.863736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b02b2-1fd2-4695-81d7-3c2db3a4dd1f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:36.870634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:36.871355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:36.871730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:36.872101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:36.882969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:36.885207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:36.907603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 844/1681] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:37.074101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf8b6675da14ce1bd4f16d74266ffd4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:37.158501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf8b6675da14ce1bd4f16d74266ffd4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:37.226666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf8b6675da14ce1bd4f16d74266ffd4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:37.227759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf8b6675da14ce1bd4f16d74266ffd4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:37.238191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-527b664a-d74c-4e56-bf53-11087b10e40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf8b6675da14ce1bd4f16d74266ffd4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:37.248855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 838/1682] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:36 2022] DELETE /identity/v3/users/caf8b6675da14ce1bd4f16d74266ffd4 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:38.101429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:38.102925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:38.130754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90efb3b-d0e3-44ab-8ed1-51a01e615f18 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:38.274004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:38.274902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:38.275721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:38.275986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] PATH_INFO: `/v3/projects/309f96243a924ac580fe63c90d699191` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:38.277249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309f96243a924ac580fe63c90d699191)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:38.287612 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:38.341937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:38.342404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:38.342501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:38.460992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] MFA Rules not processed for user `ceb7b426bbef4637890ee6e203aee9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:38.463859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:38.482074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309f96243a924ac580fe63c90d699191', 'request_id': 'req-a2a09880-8e05-458b-832b-7a55881ef177'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:38.491368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309f96243a924ac580fe63c90d699191', 'request_id': 'req-a2a09880-8e05-458b-832b-7a55881ef177'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:38.509299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309f96243a924ac580fe63c90d699191', 'request_id': 'req-a2a09880-8e05-458b-832b-7a55881ef177'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:38.623860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] The token cache is being invalidate because project 309f96243a924ac580fe63c90d699191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:38.625517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:38.625517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:38.629657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 845/1683] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:38 2022] DELETE /identity/v3/projects/309f96243a924ac580fe63c90d699191 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:38.629657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:38.634281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:38.701089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 839/1684] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:38.702311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:38.704703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:38.848393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c07e6-0b28-4dd4-8236-aab7166f3992 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:38.861358 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:38.868883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:38.868883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:38.868883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] PATH_INFO: `/v3/users/30e91aa11b5c429ca9583fc8ee729f58` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:38.875418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e91aa11b5c429ca9583fc8ee729f58)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:38.888242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:38.893655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a09880-8e05-458b-832b-7a55881ef177 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:38.912759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:38.913750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:38.914041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:38.914317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] PATH_INFO: `/v3/projects/258d328cda4b4f5889cb41a21be9db18` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:38.922960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258d328cda4b4f5889cb41a21be9db18)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:38.933633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:39.163740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e91aa11b5c429ca9583fc8ee729f58'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.169131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258d328cda4b4f5889cb41a21be9db18', 'request_id': 'req-b0d3da54-9793-490d-8434-67681cee7ff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.202561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258d328cda4b4f5889cb41a21be9db18', 'request_id': 'req-b0d3da54-9793-490d-8434-67681cee7ff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.236098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258d328cda4b4f5889cb41a21be9db18', 'request_id': 'req-b0d3da54-9793-490d-8434-67681cee7ff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.251297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e91aa11b5c429ca9583fc8ee729f58'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.271159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e91aa11b5c429ca9583fc8ee729f58'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.275856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e91aa11b5c429ca9583fc8ee729f58'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.300783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fa2c6e24-39ef-42f3-ae8c-9397e655177a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e91aa11b5c429ca9583fc8ee729f58'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.324379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 840/1685] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:38 2022] DELETE /identity/v3/users/30e91aa11b5c429ca9583fc8ee729f58 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:39.324379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ad6a4-a37c-4abe-bce0-ecfbeab5cfce None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:39.324379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ad6a4-a37c-4abe-bce0-ecfbeab5cfce None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:39.324379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ad6a4-a37c-4abe-bce0-ecfbeab5cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:39.346762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] The token cache is being invalidate because project 258d328cda4b4f5889cb41a21be9db18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:39.347045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.347722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:39.349796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 846/1686] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:38 2022] DELETE /identity/v3/projects/258d328cda4b4f5889cb41a21be9db18 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:39.350849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:39.354465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:39.371127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a55ad6a4-a37c-4abe-bce0-ecfbeab5cfce None None] MFA Rules not processed for user `ceb7b426bbef4637890ee6e203aee9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:39.377781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a55ad6a4-a37c-4abe-bce0-ecfbeab5cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:39.594180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3da54-9793-490d-8434-67681cee7ff6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:39.620010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 841/1687] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:39.628857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:39.629150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:39.629428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:39.667741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:39.669452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:39.763989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:39.766313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:39.768719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:39.769081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] PATH_INFO: `/v3/users/bed66fca3e884b1187261ed5af115a61` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:39.770532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed66fca3e884b1187261ed5af115a61)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:39.772461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:39.778075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 842/1688] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:39.779310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:39.786333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:39.912125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ee12e-fcff-4bc5-905c-0e5d22a64b2f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:39.920030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:39.920891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:39.921583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:39.921869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:39.930849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:39.971122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:39.975474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb425f-9b8e-4b2c-a182-0adb69bc7633 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:39.999423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 843/1689] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:40.002194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.004726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.007264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.046401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:40.050609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:40.071865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 844/1690] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:40.073804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.089937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed66fca3e884b1187261ed5af115a61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:40.098801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ba26-7e3a-46a0-a97f-02f9b22787ee None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.119905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.119905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.119905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.119905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.120650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:40.120650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.125941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.155521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 845/1691] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:40.161148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.187103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed66fca3e884b1187261ed5af115a61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:40.198815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292d82-835b-431e-b0b9-f0285ca4ef55 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.215102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed66fca3e884b1187261ed5af115a61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:40.218139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed66fca3e884b1187261ed5af115a61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:40.219058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.221808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6d7fccca-b11c-4e86-a653-242570a168fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed66fca3e884b1187261ed5af115a61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:40.222751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.226463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.226749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.229737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.236964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.260902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 847/1692] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:39 2022] DELETE /identity/v3/users/bed66fca3e884b1187261ed5af115a61 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:40.268596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.268890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.269175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.325815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:40.329743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:40.387398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 846/1693] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:40 2022] POST /identity/v3/projects => generated 357 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:40.392121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.396338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:40.477373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 848/1694] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:40.492169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.496323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:40.548551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112818-0f8f-4c55-9ea9-96ec312c0a57 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.563546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.563970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.564702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.565007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.566757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.571751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b7fc1-c317-4500-8bfc-d8d140207aff admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.618056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58fb6b-1947-4dee-86fe-9665936cbb9a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.689246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.690482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.690939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.691726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.702330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 847/1695] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:40 2022] POST /identity/v3/users => generated 279 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:40.709555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e6dc-6b99-48bf-9acc-7a5803d4f6fa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.709555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e6dc-6b99-48bf-9acc-7a5803d4f6fa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.709555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e6dc-6b99-48bf-9acc-7a5803d4f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.709787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.709787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.726599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 849/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:04:40.727587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.748689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c877a-b5d1-47a2-bc1f-ab7f0881551d service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.754962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.755611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.755899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.756173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.756579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4290e6dc-6b99-48bf-9acc-7a5803d4f6fa None None] MFA Rules not processed for user `45f516e419574132b8760971af6146c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:40.757793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.760149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.760990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4290e6dc-6b99-48bf-9acc-7a5803d4f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:40.787063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 850/1697] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:40.790059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.804221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1979c32-f4ec-432b-84f3-1899193ab313 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.817836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.820586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.820586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.820586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.825581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.827305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:40.855224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 851/1698] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:40.859475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:40.881899 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af01c-eb21-48f6-9e94-86d29a273e4b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:40.898151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:40.899362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:40.899507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:40.899847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] PATH_INFO: `/v3/projects/f51d3bcbeec744fd8187f4d9905855fd/users/169f89a5d52b47bdacde1a25475ffde6/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:40.942458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51d3bcbeec744fd8187f4d9905855fd, user_id=169f89a5d52b47bdacde1a25475ffde6, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:40.945725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 848/1699] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:40.952035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:41.082503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 852/1700] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:40 2022] PUT /identity/v3/projects/f51d3bcbeec744fd8187f4d9905855fd/users/169f89a5d52b47bdacde1a25475ffde6/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:41.092049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.092912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.093261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.151615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] MFA Rules not processed for user `169f89a5d52b47bdacde1a25475ffde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:41.152927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:41.283486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 849/1701] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:41 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:41.287676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:41.358882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055b48e-7369-48e4-97b3-1767cb31f597 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:41.363995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:41.364871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.365153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.365448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.366194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:41.368122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:41.415338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:41.417766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:41.440576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c301-b361-4764-adc0-cc0ce949d02b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:41.460975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:41.470570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 853/1702] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:41 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:41.471700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:41.473594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.474611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.474901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] PATH_INFO: `/v3/projects/951117a43e354814996ab94568c138c6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.479168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=951117a43e354814996ab94568c138c6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:41.487837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:41.597657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdfb4d-858e-4031-aff3-cb3282037578 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:41.607198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:41.608430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.608719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.608996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.609730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:41.612137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504c54-0b55-40c0-9d62-0646a82c77ab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:41.684140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951117a43e354814996ab94568c138c6', 'request_id': 'req-afd9f410-1878-4f52-a52d-823aa5cb9b8c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:41.699895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951117a43e354814996ab94568c138c6', 'request_id': 'req-afd9f410-1878-4f52-a52d-823aa5cb9b8c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:41.710167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951117a43e354814996ab94568c138c6', 'request_id': 'req-afd9f410-1878-4f52-a52d-823aa5cb9b8c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:41.801686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] The token cache is being invalidate because project 951117a43e354814996ab94568c138c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:41.802468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:41.803452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-afd9f410-1878-4f52-a52d-823aa5cb9b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:41.805787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 854/1703] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:41 2022] POST /identity/v3/users => generated 285 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:41.806243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 850/1704] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:41 2022] DELETE /identity/v3/projects/951117a43e354814996ab94568c138c6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:04:41.809086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.811864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:41.812155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.812435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.815995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 855/1705] 10.222.0.26 () {54 vars in 912 bytes} [Tue Aug 23 06:04:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:41.816611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:41.818412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:41.818783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:41.821424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:41.823901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 851/1706] 10.222.0.26 () {54 vars in 912 bytes} [Tue Aug 23 06:04:41 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:41.826315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:41.830696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:41.991588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b684-f666-495f-8c19-4da8fd9b1c7c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:41.996844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae5ae9-e56c-4c78-8d7d-5e3cc2c543c5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.000610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.002038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.002312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.018052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] PATH_INFO: `/v3/projects/971c5b3f52424429938eab4f27b2fa70` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.019076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.019896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.021144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971c5b3f52424429938eab4f27b2fa70)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.024490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.024640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.025467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.029087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.032078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9790f08-9d6d-461d-952b-e3d2deb604c9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.060992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 852/1707] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:42.064291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a610013-7200-4057-bc96-5e51b6063978 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.064669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a610013-7200-4057-bc96-5e51b6063978 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.065037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a610013-7200-4057-bc96-5e51b6063978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.111307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2a610013-7200-4057-bc96-5e51b6063978 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.111307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a610013-7200-4057-bc96-5e51b6063978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.132321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 853/1708] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.132321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3affa-603c-41cc-8585-ee8ab71cc9ec None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.132321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3affa-603c-41cc-8585-ee8ab71cc9ec None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.132321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3affa-603c-41cc-8585-ee8ab71cc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.196514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5fa3affa-603c-41cc-8585-ee8ab71cc9ec None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.205614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5fa3affa-603c-41cc-8585-ee8ab71cc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.210939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971c5b3f52424429938eab4f27b2fa70', 'request_id': 'req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:42.233216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971c5b3f52424429938eab4f27b2fa70', 'request_id': 'req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:42.250505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971c5b3f52424429938eab4f27b2fa70', 'request_id': 'req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:42.317883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 854/1709] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.319485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbfe1-db20-4d8f-a6eb-86dbafff6f67 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.319807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbfe1-db20-4d8f-a6eb-86dbafff6f67 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.320093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbfe1-db20-4d8f-a6eb-86dbafff6f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.352668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-df4cbfe1-db20-4d8f-a6eb-86dbafff6f67 None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.354846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-df4cbfe1-db20-4d8f-a6eb-86dbafff6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.366805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 855/1710] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.369185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a28a9-d153-4a57-bfd4-ffb866ba347f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.369713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a28a9-d153-4a57-bfd4-ffb866ba347f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.370356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a28a9-d153-4a57-bfd4-ffb866ba347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.410738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] The token cache is being invalidate because project 971c5b3f52424429938eab4f27b2fa70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:42.410738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:42.410738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:42.410738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 856/1711] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:41 2022] DELETE /identity/v3/projects/971c5b3f52424429938eab4f27b2fa70 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:42.411373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.412323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.440692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f53a28a9-d153-4a57-bfd4-ffb866ba347f None None] MFA Rules not processed for user `d2bd1b793a33487b834c4684b7c31231`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.442128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f53a28a9-d153-4a57-bfd4-ffb866ba347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.511671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4889c-5e63-4bc2-94ef-ad9938f7a985 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.516893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.517953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.518281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.518564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] PATH_INFO: `/v3/projects/60656465a46945069ff46ab0cd3e05c6/users/8d456acbbcf844ec9eecce8e415f7184/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.535079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60656465a46945069ff46ab0cd3e05c6, user_id=8d456acbbcf844ec9eecce8e415f7184, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.538289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.542790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 856/1712] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.544402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe979505-eb33-4243-a629-8fbd4e338326 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.544727 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe979505-eb33-4243-a629-8fbd4e338326 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.545020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe979505-eb33-4243-a629-8fbd4e338326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.564369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fe979505-eb33-4243-a629-8fbd4e338326 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.565620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fe979505-eb33-4243-a629-8fbd4e338326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.573871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 857/1713] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.575029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.575320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.575604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.602422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] MFA Rules not processed for user `a3b54fb538d04a2f8be2cb3c88f38d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.604411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.620249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 857/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:42 2022] PUT /identity/v3/projects/60656465a46945069ff46ab0cd3e05c6/users/8d456acbbcf844ec9eecce8e415f7184/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:42.621334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.623602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.714042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 858/1715] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.714236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244f26-ae0b-4618-a932-f18a09e08251 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.714357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.714357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.714512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.714512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.714512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.714512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.715287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.723879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5303-b63c-482d-8667-5314c8f3cea5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.725861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.727331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.727619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.728812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.729096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.729372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.731696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.744248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.745818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59dd95-2275-43dd-8c68-1c770b59deb3 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.753667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 858/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:42.756654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 859/1717] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:42.758096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac078-5521-449a-a095-b25bb9760067 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.758393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac078-5521-449a-a095-b25bb9760067 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.758675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac078-5521-449a-a095-b25bb9760067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.768513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.770241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.810988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-430ac078-5521-449a-a095-b25bb9760067 None None] MFA Rules not processed for user `e7b48227a0dd443996039fdd00ad95b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:42.812501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-430ac078-5521-449a-a095-b25bb9760067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:42.875373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf87e-4d6e-438a-b2fe-08065f95b3eb service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.884645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.886132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.886645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.887337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] PATH_INFO: `/v3/users/3ba27eece4d049b3af7d97608387d7f4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.889813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba27eece4d049b3af7d97608387d7f4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.894298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.933320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 860/1718] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:42.933320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac078-5521-449a-a095-b25bb9760067 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.943548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac078-5521-449a-a095-b25bb9760067 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.949169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.950046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.950366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.950709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:42.951507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:42.951900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:42.953686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:42.973374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 861/1719] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:42.974407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:42.990100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dba687-5a1c-447c-ba89-9e5eb84f01c5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:42.997690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:42.998454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:42.998893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:42.999818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.000636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:43.002363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a3519-8abc-4681-a25b-edefb61fdba6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:43.018565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 862/1720] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:43.024446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.024705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.024916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.064989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] MFA Rules not processed for user `e7b48227a0dd443996039fdd00ad95b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:43.074050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.085357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 863/1721] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:43.090272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.105530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb6c1b-929e-458b-ba95-e2aae9d1a558 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:43.110827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:43.111683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.112110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.112796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.114027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:43.116134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:43.147454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba27eece4d049b3af7d97608387d7f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:43.246048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba27eece4d049b3af7d97608387d7f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:43.256525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 864/1722] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:43 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:43.257633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.272814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba27eece4d049b3af7d97608387d7f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:43.275943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba27eece4d049b3af7d97608387d7f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:43.277028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba27eece4d049b3af7d97608387d7f4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:43.315528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 859/1723] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:42 2022] DELETE /identity/v3/users/3ba27eece4d049b3af7d97608387d7f4 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:43.316921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.320670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.449935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3aa97-edef-469f-a312-3a21815dfe33 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:43.495193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578c6cc-91bd-4f64-a904-45bfa4bb4b91 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:43.501342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:43.502053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.502558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.503029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.503903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:43.511552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:43.646862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:43.654194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.655780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.667595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 860/1724] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:43 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:43.667595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.667746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] PATH_INFO: `/v3/projects/60656465a46945069ff46ab0cd3e05c6/users/8d456acbbcf844ec9eecce8e415f7184/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.668005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.675953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60656465a46945069ff46ab0cd3e05c6, user_id=8d456acbbcf844ec9eecce8e415f7184, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:43.678776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:43.714402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 865/1725] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:43 2022] PUT /identity/v3/projects/60656465a46945069ff46ab0cd3e05c6/users/8d456acbbcf844ec9eecce8e415f7184/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:43.718016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.731463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.846779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b814a-2442-4402-a797-42f4faaefb70 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:43.857878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:43.858776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.859205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.860211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.863252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.895237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89ad8-c9cf-4bbf-b8bf-09c2b1d89669 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:43.913995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:43.914901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:43.915850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:43.916586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:43.922964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:43.967770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:43.969908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:43.986553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 866/1726] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:43.987654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:43.994316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.128935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292a58-faf8-4c68-bccd-4e8953d47231 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.140138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.141922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.142075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.142590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.142873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.143149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.145021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.160001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 861/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:44.160001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.161331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.162799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.176292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 867/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:44.177090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.182291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.202993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c48e-2d92-4882-9c47-4ca6f33c1af6 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.209677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.210412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.210704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.210982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.223593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.225208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb095deb-322c-46c8-9e52-280e7e3b9d6b service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.237825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 868/1729] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:44.239218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.239513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.239821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.240958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220036c-66b4-4583-bb50-c222270105f7 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.264086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.264375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.267051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.267364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.269707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.279441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.289848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] MFA Rules not processed for user `8d456acbbcf844ec9eecce8e415f7184`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:44.291966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.325485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 862/1730] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:44.325885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.328947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.343645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bfa8-0f89-4c31-8d20-09a353cd297c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.354965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.355854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.356141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.356418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] PATH_INFO: `/v3/projects/9ca0484499b6432eb1f1d15475aba982` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.357715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca0484499b6432eb1f1d15475aba982)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.359936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.444837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 869/1731] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:44 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:44.445709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.504027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7302e-9770-4e2b-bcc4-c474f96dda22 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.536329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.538517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.538804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.541093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.551702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.592425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca0484499b6432eb1f1d15475aba982', 'request_id': 'req-29ada104-0699-476d-8af0-890b2e1ecb05'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:44.628080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca0484499b6432eb1f1d15475aba982', 'request_id': 'req-29ada104-0699-476d-8af0-890b2e1ecb05'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:44.671829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca0484499b6432eb1f1d15475aba982', 'request_id': 'req-29ada104-0699-476d-8af0-890b2e1ecb05'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:44.758467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.760928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.773269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 870/1732] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:44.774158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.785778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1077-b9e1-4b83-88f1-4ca36792c5cc service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.804231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] The token cache is being invalidate because project 9ca0484499b6432eb1f1d15475aba982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:44.804556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:44.806875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:44.807158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 863/1733] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:44 2022] DELETE /identity/v3/projects/9ca0484499b6432eb1f1d15475aba982 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:44.807933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:44.811194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.954323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.955005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.956117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.956117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.956488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:44.958789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1a78c-29c4-44b4-8a15-7e11bd617b95 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:44.975883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 871/1734] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:44.975883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596e2b0-de8e-420b-9beb-57e04d2480d8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.975883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596e2b0-de8e-420b-9beb-57e04d2480d8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.975883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596e2b0-de8e-420b-9beb-57e04d2480d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.978416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada104-0699-476d-8af0-890b2e1ecb05 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:44.984816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:44.985944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:44.986339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:44.986850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:44.990583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:44.995322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6596e2b0-de8e-420b-9beb-57e04d2480d8 None None] MFA Rules not processed for user `ceb7b426bbef4637890ee6e203aee9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:44.996682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6596e2b0-de8e-420b-9beb-57e04d2480d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.105316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 872/1735] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:45.107401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62f49-8794-4e02-a807-522471fefa92 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.109235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62f49-8794-4e02-a807-522471fefa92 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.111176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62f49-8794-4e02-a807-522471fefa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.111627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:45.113357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:45.125066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 864/1736] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:44 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:45.132003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:45.132003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.142661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9facf5c-9fcc-4ac2-ac0b-f0648b7d0006 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:45.158022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:45.159508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.159508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.159700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] PATH_INFO: `/v3/projects/5fefb3ba815c42b2b4d8552ca113c294/users/9f27656d4d984096bbe1ecc4e9fcd609/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.183063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fefb3ba815c42b2b4d8552ca113c294, user_id=9f27656d4d984096bbe1ecc4e9fcd609, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:45.185777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66493a-81ef-4501-bb82-7821be47224b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:45.198635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a3e62f49-8794-4e02-a807-522471fefa92 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:45.199784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a3e62f49-8794-4e02-a807-522471fefa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.220285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 873/1737] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:45.230328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.230619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.230903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.278005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:45.281159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.303022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 874/1738] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:45.307602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:45.329810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cc905-77f5-4702-93aa-7d6603f720cd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:45.335440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 865/1739] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:45 2022] PUT /identity/v3/projects/5fefb3ba815c42b2b4d8552ca113c294/users/9f27656d4d984096bbe1ecc4e9fcd609/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:45.348596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.348881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.349156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.436148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] MFA Rules not processed for user `9f27656d4d984096bbe1ecc4e9fcd609`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:45.443248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.561822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:45.564650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.564946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.567855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.570777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:04:45.573232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:45.578566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:45.607688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 875/1740] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:04:45.608912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:45.640047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 866/1741] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:45.641869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:45.662387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c95c43-9d88-4bda-bf21-d2872369b7a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:45.678796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:45.680335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.680924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.681461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.682498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:45.686211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:45.789416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6f04-4d6c-4abb-b4fc-1011d177c6f3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:45.798176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:45.801118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:45.801118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:45.802096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:45.816975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:45.885475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 867/1742] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:45 2022] POST /identity/v3/projects => generated 369 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:45.886696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.023328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.024849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.047738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 876/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:45 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:46.048874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.072047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe9288-63be-431d-bc14-c2427d4ce0ea service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.150324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a65d6-01ff-4375-8c7f-65bb465b9b5a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.195049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.197512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.202594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.206969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.210585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.228743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.239609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.240304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.240591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.240858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.241583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.253907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.428555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 877/1744] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:46 2022] POST /identity/v3/users => generated 285 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:46.434979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 868/1745] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:45 2022] POST /identity/v3/projects => generated 387 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:46.436383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.436641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.469181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f5609-9421-47c0-9b18-6dae04a4e6c5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.605503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289003-a519-45e3-b113-2af33baff69a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.625914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.627290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.627673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.628365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.630468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.631114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.631225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.631460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.631750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.632518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.634798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.635491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.654686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 878/1746] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:46.658537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.670860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa90b5-8dde-466a-b177-7796cdd7f573 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.676087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.676891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.677087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.677366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.678197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.681481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.691513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 879/1747] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:04:46.695714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.707336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57106f0-a551-4568-9425-1ff36bc859d3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.712242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.713126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.713503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.713758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] PATH_INFO: `/v3/projects/f92e13fb99914f0eb90368e9e764645c/users/d15f656c3dfa436e9e124390c5dea200/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.731123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 869/1748] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:46 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:46.736657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.781607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6298b-e75d-44b3-8a0c-848e00f8c1fa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.805044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.806407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.807284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.807284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.809137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92e13fb99914f0eb90368e9e764645c, user_id=d15f656c3dfa436e9e124390c5dea200, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.810135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.813562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.818427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f50f4-e9df-472b-9025-536df7faf956 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.850394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 870/1749] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:46.851366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.886561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afc146-2c44-4c2c-ad11-a5730f3654c1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.911432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:46.911987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.912274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.912574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:46.915504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:46.915504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:46.930066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 871/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:46.935731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:46.961210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabfde-57ea-4923-a3db-e98c79b3c318 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:46.965605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 880/1751] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:46 2022] PUT /identity/v3/projects/f92e13fb99914f0eb90368e9e764645c/users/d15f656c3dfa436e9e124390c5dea200/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:46.978232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:46.978529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:46.978809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.091894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] MFA Rules not processed for user `d15f656c3dfa436e9e124390c5dea200`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:47.096881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:47.150804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:47.160036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.160326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.160606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] PATH_INFO: `/v3/projects/6362ab95b61d40738d59b750d26e4286/users/06c0b6c7b13b491cb40600e35430fe86/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.230141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6362ab95b61d40738d59b750d26e4286, user_id=06c0b6c7b13b491cb40600e35430fe86, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:47.241288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88403-79a7-4d14-861e-580e0e3b0999 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:47.313063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 881/1752] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:47.318078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.342555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349bc25-94d6-4654-8eeb-e191b126605a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:47.353824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:47.354369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.354730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.355195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.355937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:47.359234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:47.378954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 872/1753] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:46 2022] PUT /identity/v3/projects/6362ab95b61d40738d59b750d26e4286/users/06c0b6c7b13b491cb40600e35430fe86/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:47.393655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.394042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.394394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.458022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] MFA Rules not processed for user `06c0b6c7b13b491cb40600e35430fe86`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:47.459749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:47.510171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 882/1754] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:47 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:47.512285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.622630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 873/1755] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:47.625808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.672759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffdf33-14c4-4a60-a01a-d5a94f7dc0f2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:47.690432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:47.691079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.691505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.691849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.694016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:47.697204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:47.811092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d65df-04a3-4e09-96a2-1093654e8b86 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:47.816497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:47.817179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.817642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.825973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.825973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:47.825973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:47.853516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 883/1756] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:47 2022] POST /identity/v3/users => generated 291 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:47.857542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.881039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158401-01bc-40a2-9ff5-91bb3e28fdca admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:47.892933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:47.894642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:47.900848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:47.900848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:47.900848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:47.900848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:47.926891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 884/1757] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:47.933160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.956253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 874/1758] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:04:47 2022] POST /identity/v3/projects => generated 387 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:47.957846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:47.969787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43027408-ee46-4d9a-bdd1-ae2fa0429923 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.115291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.115291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.115291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.115291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] PATH_INFO: `/v3/projects/e47b4acdf7904c3f8fca9b498e79694f/users/6a38fbcd4c5846d887f4a8964965bbb1/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.149155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47b4acdf7904c3f8fca9b498e79694f, user_id=6a38fbcd4c5846d887f4a8964965bbb1, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.149155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.259925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118e9e-9974-4909-8e27-8eff184d810a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.270287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 885/1759] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:47 2022] PUT /identity/v3/projects/e47b4acdf7904c3f8fca9b498e79694f/users/6a38fbcd4c5846d887f4a8964965bbb1/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:48.272066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:48.378297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.379179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.379593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.379969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.382711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.388204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.422498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555638-a982-4c17-ba67-7f8472c76180 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.433323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.434421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.435090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.435567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.436521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.438568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.451502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 886/1760] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:04:48.455451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:48.465658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6cba-ead9-4e7d-aeb6-8c2021e4d58c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.470589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.471468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.471773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.472047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] PATH_INFO: `/v3/projects/e47b4acdf7904c3f8fca9b498e79694f/users/6a38fbcd4c5846d887f4a8964965bbb1/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.474658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47b4acdf7904c3f8fca9b498e79694f, user_id=6a38fbcd4c5846d887f4a8964965bbb1, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.478188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19aab-0c56-476a-8fbd-aa4be1e7dc3e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.493459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 887/1761] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:48 2022] PUT /identity/v3/projects/e47b4acdf7904c3f8fca9b498e79694f/users/6a38fbcd4c5846d887f4a8964965bbb1/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:04:48.508395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.509144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.509459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.531289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 875/1762] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:04:47 2022] POST /identity/v3/users => generated 300 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:04:48.537404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:48.573530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] MFA Rules not processed for user `6a38fbcd4c5846d887f4a8964965bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:48.574823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda55-f0a4-4bea-a12f-3bec54a127d4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.575166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:48.679441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 888/1763] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:48.690731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:48.692726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:48.758890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.759872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.761211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.761758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.765091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.767628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.786167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 876/1764] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:48.791057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:48.816037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3d68-8448-48da-9861-603ab310c13f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.826756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ab61e-9c09-47ba-b23a-f530fce091d9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:48.830786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.831692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.832120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.832550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.849108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.851874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:48.855644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:48.856742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:48.857022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:48.857308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] PATH_INFO: `/v3/projects/e5fb47def95643cb8475d552a82f8236/users/c47c30e4e1554e4dbdb1423637e33461/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:48.872883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 889/1765] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:48.875237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fb47def95643cb8475d552a82f8236, user_id=c47c30e4e1554e4dbdb1423637e33461, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:48.878154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:49.068510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 877/1766] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:48 2022] PUT /identity/v3/projects/e5fb47def95643cb8475d552a82f8236/users/c47c30e4e1554e4dbdb1423637e33461/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:04:49.069291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:49.082857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d70fa-35a1-498c-8039-2f6d9fb4f514 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:49.304687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:49.305593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:49.315665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:49.315665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:49.315665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:49.315665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316fb83-4314-490a-a697-bcecbe1deb39 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:49.323789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 890/1767] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:04:49.326170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:49.345499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af9475-a0b7-4c4f-9bac-009605628df5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:49.358938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:49.360249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:49.360535 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:49.360889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] PATH_INFO: `/v3/projects/e5fb47def95643cb8475d552a82f8236/users/c47c30e4e1554e4dbdb1423637e33461/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:49.363578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fb47def95643cb8475d552a82f8236, user_id=c47c30e4e1554e4dbdb1423637e33461, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:49.366706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:49.413837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 878/1768] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:04:49 2022] PUT /identity/v3/projects/e5fb47def95643cb8475d552a82f8236/users/c47c30e4e1554e4dbdb1423637e33461/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:49.424444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbe68-d45b-40ae-9a1a-915325b4800a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:49.424739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbe68-d45b-40ae-9a1a-915325b4800a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:49.425020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbe68-d45b-40ae-9a1a-915325b4800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:49.466215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce5cbe68-d45b-40ae-9a1a-915325b4800a None None] MFA Rules not processed for user `c47c30e4e1554e4dbdb1423637e33461`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:49.467426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce5cbe68-d45b-40ae-9a1a-915325b4800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:49.571877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 891/1769] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:49.583199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:49.724603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da8d4-be96-4b79-a3f6-40b9e7b300ec admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:49.729334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:49.730259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:49.730767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:49.731246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:49.744388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:49.746853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:49.762199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 879/1770] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:50.447597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:50.448715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:50.449275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:50.478675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:50.479909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:50.667823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 892/1771] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:04:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:51.221910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:51.223454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:51.372964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568ef40-06de-4b60-b839-2ac85226669f service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:51.387450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:51.389466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:51.389939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:51.390366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:51.418880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:51.420759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d886b26-a691-4dc4-aec7-5d28f96fd718 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:51.448243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 880/1772] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:04:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:04:52.265801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:52.279855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175d250-78d4-4473-af06-23ef54e2183a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:52.298214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:52.298888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:52.299171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:52.299447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:52.438120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:52.439168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:52.439639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:52.508856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:52.510902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ac2fb-de0f-436a-87cc-966ec95190b8 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:52.525304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] MFA Rules not processed for user `a3b54fb538d04a2f8be2cb3c88f38d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:52.529217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:52.538141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 893/1773] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:52.738405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 881/1774] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f69d6-ab78-405e-8725-7b152a3b10e1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f69d6-ab78-405e-8725-7b152a3b10e1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f69d6-ab78-405e-8725-7b152a3b10e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7d8f69d6-ab78-405e-8725-7b152a3b10e1 None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7d8f69d6-ab78-405e-8725-7b152a3b10e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:53.269990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 894/1775] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 23 06:04:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:53.271070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:53.271070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:53.271070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acc24d-a43b-4a9a-ba5c-4b2d88e9ca57 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:53.271980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:53.271980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:53.271980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:53.271980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:53.272868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:53.272868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:53.272868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 882/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:53.713183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41074c-f013-44d0-97f8-01fc561263ed None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:53.713749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41074c-f013-44d0-97f8-01fc561263ed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:53.714219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41074c-f013-44d0-97f8-01fc561263ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:53.773003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ad41074c-f013-44d0-97f8-01fc561263ed None None] MFA Rules not processed for user `d2bd1b793a33487b834c4684b7c31231`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:53.781815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ad41074c-f013-44d0-97f8-01fc561263ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:53.996672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 895/1777] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:56.157039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:56.334279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a651-2ab8-4562-9e33-b51bdfef9420 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:56.355474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:56.359649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:56.360264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:56.360744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] PATH_INFO: `/v3/users/d15f656c3dfa436e9e124390c5dea200` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:56.362760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15f656c3dfa436e9e124390c5dea200)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:56.365777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:56.690912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15f656c3dfa436e9e124390c5dea200'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:56.815197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15f656c3dfa436e9e124390c5dea200'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:56.836420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15f656c3dfa436e9e124390c5dea200'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:56.839772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15f656c3dfa436e9e124390c5dea200'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:56.878035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24c6c684-7530-4f42-b224-9de76972a895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15f656c3dfa436e9e124390c5dea200'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:56.913534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 883/1778] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:56 2022] DELETE /identity/v3/users/d15f656c3dfa436e9e124390c5dea200 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:56.915212 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:56.916647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:56.917018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:56.977586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:56.979563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:57.057303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc87a-3e0d-4c02-b63f-c3a6df5dc3d1 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:57.058213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc87a-3e0d-4c02-b63f-c3a6df5dc3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:57.058885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cc87a-3e0d-4c02-b63f-c3a6df5dc3d1 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:57.063041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 884/1779] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:04:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:04:57.088321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 896/1780] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:04:57.112494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:57.112494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:57.112494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:57.142123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:57.150138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:57.154877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:57.157296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:57.415458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94886ff-c3df-44eb-8dce-3b0b23d0c885 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:57.419881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:57.420634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:57.420912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:57.421356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:57.428587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 885/1781] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:04:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:57.438831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:57.444886 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680b815-82a8-47dc-ad2c-5c5dc11069fe service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:57.477159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 897/1782] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:58.390631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:58.392334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:58.401664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab31f-58d6-4654-8d57-645da5f9b7ba None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:58.402865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab31f-58d6-4654-8d57-645da5f9b7ba None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:58.403331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab31f-58d6-4654-8d57-645da5f9b7ba None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:58.405977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 898/1783] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 06:04:58.424255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:58.424921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:58.425517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:58.429683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ccd76-43a8-45f3-a672-9f003021c4a2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:58.455454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:58.456313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:58.456606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:58.456880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:58.471941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:04:58.473420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:58.504550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:58.508777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 899/1784] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:04:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:04:58.513912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:58.550658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 886/1785] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:59.442618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:59.444123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:04:59.472905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5118-bb9a-4834-988e-6a08412fef38 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:59.504707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:59.509411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:59.510201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:59.511130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] PATH_INFO: `/v3/projects/f92e13fb99914f0eb90368e9e764645c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:59.515663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:59.516364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92e13fb99914f0eb90368e9e764645c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:59.522530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:59.534085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cac0-505b-4e82-8fb1-ac8927955bc3 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:04:59.554618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:04:59.558826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:04:59.559845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:04:59.560317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:04:59.575078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:04:59.577181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:04:59.621921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 887/1786] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:04:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:04:59.725384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92e13fb99914f0eb90368e9e764645c', 'request_id': 'req-5939238f-7f6a-4f20-aefe-e63dcfc28177'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:59.752132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92e13fb99914f0eb90368e9e764645c', 'request_id': 'req-5939238f-7f6a-4f20-aefe-e63dcfc28177'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:59.766267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92e13fb99914f0eb90368e9e764645c', 'request_id': 'req-5939238f-7f6a-4f20-aefe-e63dcfc28177'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:59.879027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] The token cache is being invalidate because project f92e13fb99914f0eb90368e9e764645c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:04:59.879451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:59.880375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:04:59.882669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 900/1787] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:04:59 2022] DELETE /identity/v3/projects/f92e13fb99914f0eb90368e9e764645c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:04:59.888749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:04:59.906041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b906-775a-4e7e-ac65-99b1a8a0c805 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:00.055661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:00.056717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:00.056822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:00.057078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] PATH_INFO: `/v3/users/6a38fbcd4c5846d887f4a8964965bbb1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:00.059580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a38fbcd4c5846d887f4a8964965bbb1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:00.062887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:00.391524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a38fbcd4c5846d887f4a8964965bbb1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:00.495081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a38fbcd4c5846d887f4a8964965bbb1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:00.518599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a38fbcd4c5846d887f4a8964965bbb1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:00.520134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a38fbcd4c5846d887f4a8964965bbb1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:00.520893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a38fbcd4c5846d887f4a8964965bbb1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:00.535595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 888/1788] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:04:59 2022] DELETE /identity/v3/users/6a38fbcd4c5846d887f4a8964965bbb1 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:01.819085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:01.821705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:01.874334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:01.876055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:01.956481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939238f-7f6a-4f20-aefe-e63dcfc28177 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:02.013000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae221-3428-4bfa-9552-7b2f9e34bbdc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:02.019620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:02.020506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.025168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.025168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] PATH_INFO: `/v3/projects/e47b4acdf7904c3f8fca9b498e79694f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.025168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47b4acdf7904c3f8fca9b498e79694f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:02.025168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:02.079657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:02.080323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.080818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.081162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.083417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:02.197706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:02.199696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f55eec-1cfd-4bb6-bce4-27313cb9ba34 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:02.210786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 901/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:02.245526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47b4acdf7904c3f8fca9b498e79694f', 'request_id': 'req-8921b55d-7fe1-44f7-990b-e947b7235c1f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:02.257007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47b4acdf7904c3f8fca9b498e79694f', 'request_id': 'req-8921b55d-7fe1-44f7-990b-e947b7235c1f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:02.280589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47b4acdf7904c3f8fca9b498e79694f', 'request_id': 'req-8921b55d-7fe1-44f7-990b-e947b7235c1f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:02.380999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] The token cache is being invalidate because project e47b4acdf7904c3f8fca9b498e79694f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:02.384342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:02.386906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8921b55d-7fe1-44f7-990b-e947b7235c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:02.390228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 889/1790] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:01 2022] DELETE /identity/v3/projects/e47b4acdf7904c3f8fca9b498e79694f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:02.395554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.396027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.396498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.428167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:02.429403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:02.597665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 902/1791] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:02.603450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.604121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.604432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.625514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:02.627439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:02.637066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 890/1792] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:02.642625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:02.655315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34c54-b4f1-40d3-8a5e-8bf780d1f071 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:02.660586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:02.661328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.661715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.662007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.662771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:02.663101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:02.664754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:02.678113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 903/1793] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:02.682411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:02.692433 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e65df-52e6-4482-8491-a7b3ec10cc3a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:02.698164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:02.699130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.699686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.700179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.701084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:02.703578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:02.834024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 891/1794] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:02 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:02.840725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:02.852423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da5bb-b4f8-4751-bd4a-b9ffc313d57e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:02.916753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:02.917998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:02.918622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:02.919041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:02.920063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:02.922269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:03.144417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 904/1795] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:02 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:03.148643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:03.160516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6fa9-4032-4363-a24a-1f911db6f27d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:03.165196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:03.166923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:03.166923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:03.166923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:03.167252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:03.168863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:03.189660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 892/1796] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:03.189761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:03.201103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e7a4f-74d9-4015-b662-9394bff3bb84 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:03.206270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:03.207120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:03.207479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:03.207863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:03.208684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:03.210760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713b83-b6e3-43ac-aa25-0103f17f0dba admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:03.225481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 905/1797] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:05:03.230247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:03.243613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647304c1-9426-441f-ba5f-13f57d94cba2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:03.248806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:03.249810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:03.250023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:03.250325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] PATH_INFO: `/v3/projects/0b61c13b60e04851ab9928df7b22d47f/users/51917fdf26ee4f8a8fffec995002394c/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:03.265960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b61c13b60e04851ab9928df7b22d47f, user_id=51917fdf26ee4f8a8fffec995002394c, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:03.268784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:03.524173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 893/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:03 2022] PUT /identity/v3/projects/0b61c13b60e04851ab9928df7b22d47f/users/51917fdf26ee4f8a8fffec995002394c/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:03.542798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:03.543234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:03.543519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:03.583836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] MFA Rules not processed for user `51917fdf26ee4f8a8fffec995002394c`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:03.585052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:03.699930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 906/1799] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:03.704579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:03.804327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7daa-bf31-4d27-9a0a-7c5c713dda07 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:03.809024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:03.809708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:03.810035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:03.810320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:03.811014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:03.812989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.010477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 894/1800] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:03 2022] POST /identity/v3/projects => generated 393 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:04.015107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.026036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5b275-d6df-4470-a229-43e3eb18c980 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.093777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.094671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.095010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.095457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.098261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.100258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.204337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 907/1801] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:04 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:04.208267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.220908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6ddf-ae50-47b6-b3d1-393d0464e751 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.225880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.226576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.226884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.227162 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.227889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.229654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.242107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 895/1802] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:04.246337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.264354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b750-102f-4125-8b05-c80ef5054202 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.269609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.274272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.274272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.274272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] PATH_INFO: `/v3/projects/2ed4d8d985c645388ec1a4052253fffd/users/5031224af1d249b8a0d29ee24e86d5f1/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.286897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed4d8d985c645388ec1a4052253fffd, user_id=5031224af1d249b8a0d29ee24e86d5f1, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.289635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.427360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 908/1803] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:04 2022] PUT /identity/v3/projects/2ed4d8d985c645388ec1a4052253fffd/users/5031224af1d249b8a0d29ee24e86d5f1/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:04.431507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.442743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73954035-3e6a-4bf0-ac94-4c26b2ed0eff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.499821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.500479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.500776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.501032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.501783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.503641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c5bb4-a7e7-459e-8b64-20e1b7d47672 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.514166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 896/1804] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:04.518536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.528948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528112bc-8fe8-4cd6-9e45-2dfc90426455 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.534401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.538143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.538143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.538143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] PATH_INFO: `/v3/projects/2ed4d8d985c645388ec1a4052253fffd/users/5031224af1d249b8a0d29ee24e86d5f1/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.538143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed4d8d985c645388ec1a4052253fffd, user_id=5031224af1d249b8a0d29ee24e86d5f1, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.541001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.565253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 909/1805] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:04 2022] PUT /identity/v3/projects/2ed4d8d985c645388ec1a4052253fffd/users/5031224af1d249b8a0d29ee24e86d5f1/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:04.567268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.567558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.567845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.596498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] MFA Rules not processed for user `5031224af1d249b8a0d29ee24e86d5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:04.597742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:04.671364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 897/1806] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:04.683545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.685199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:04.745904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922c9b6-b90a-478d-8dc7-d16dbf398309 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.749611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.750193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.750474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.750813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.760515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.762067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.771609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 910/1807] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:05:04.821739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:04.831933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052548c-aa61-4c6a-a8f2-a237d0459477 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:04.835718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:04.836427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:04.836710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:04.836984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:04.915982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:04.915982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7008da-ca8d-4ae6-a6e8-cb0d79f45389 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:04.921072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 898/1808] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:07.592210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:07.594304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:07.718837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c09ebc-a02d-4a95-aa20-5df4f13ca13b service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:07.736685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:07.736685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:07.736685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:07.736685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] PATH_INFO: `/v3/users/9f27656d4d984096bbe1ecc4e9fcd609` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:07.737404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f27656d4d984096bbe1ecc4e9fcd609)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:07.745125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:08.127409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f27656d4d984096bbe1ecc4e9fcd609'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:08.202776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f27656d4d984096bbe1ecc4e9fcd609'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:08.221752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f27656d4d984096bbe1ecc4e9fcd609'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:08.223396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f27656d4d984096bbe1ecc4e9fcd609'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:08.231736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f27656d4d984096bbe1ecc4e9fcd609'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:08.243175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 911/1809] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:07 2022] DELETE /identity/v3/users/9f27656d4d984096bbe1ecc4e9fcd609 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:08.244810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:08.246912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:08.247274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:08.268278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:08.269641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:08.364987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 899/1810] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:08.375783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:08.377845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:08.492791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aee939-f035-4f4e-b7cd-1ec81b049e6c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:08.502028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:08.505243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:08.505243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:08.506026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:08.528904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:08.529800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:08.565867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 912/1811] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:10.188408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:10.190191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:10.208067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b58fa0-069e-4fe4-b8b3-10bcbebd8e0d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:10.223461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:10.228414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:10.228414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:10.228414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] PATH_INFO: `/v3/projects/5fefb3ba815c42b2b4d8552ca113c294` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:10.228414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fefb3ba815c42b2b4d8552ca113c294)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:10.239634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:10.421716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fefb3ba815c42b2b4d8552ca113c294', 'request_id': 'req-3052c0e5-3bba-4bf1-925b-61c7039bb22e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:10.428530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fefb3ba815c42b2b4d8552ca113c294', 'request_id': 'req-3052c0e5-3bba-4bf1-925b-61c7039bb22e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:10.436569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fefb3ba815c42b2b4d8552ca113c294', 'request_id': 'req-3052c0e5-3bba-4bf1-925b-61c7039bb22e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:10.585042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] The token cache is being invalidate because project 5fefb3ba815c42b2b4d8552ca113c294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:10.585874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:10.586832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:10.588968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 900/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:10 2022] DELETE /identity/v3/projects/5fefb3ba815c42b2b4d8552ca113c294 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:10.593077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:10.605369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f109-e15e-489d-82d2-f6ed9566f095 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:10.670104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:10.671028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:10.671320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:10.671630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] PATH_INFO: `/v3/users/06c0b6c7b13b491cb40600e35430fe86` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:10.672900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c0b6c7b13b491cb40600e35430fe86)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:10.674953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:10.967214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c0b6c7b13b491cb40600e35430fe86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.122697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c0b6c7b13b491cb40600e35430fe86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.136678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c0b6c7b13b491cb40600e35430fe86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.137402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c0b6c7b13b491cb40600e35430fe86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.144338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c0b6c7b13b491cb40600e35430fe86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.154052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 913/1813] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:10 2022] DELETE /identity/v3/users/06c0b6c7b13b491cb40600e35430fe86 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:11.743329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:11.744865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:11.759011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c0e5-3bba-4bf1-925b-61c7039bb22e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:11.819819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:11.820955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:11.821239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:11.821548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] PATH_INFO: `/v3/projects/6362ab95b61d40738d59b750d26e4286` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:11.822801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6362ab95b61d40738d59b750d26e4286)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:11.824761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:11.956581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6362ab95b61d40738d59b750d26e4286', 'request_id': 'req-69b76731-dd25-4878-92b6-839145bca17d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.963250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6362ab95b61d40738d59b750d26e4286', 'request_id': 'req-69b76731-dd25-4878-92b6-839145bca17d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:11.968753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6362ab95b61d40738d59b750d26e4286', 'request_id': 'req-69b76731-dd25-4878-92b6-839145bca17d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.088687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] The token cache is being invalidate because project 6362ab95b61d40738d59b750d26e4286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:12.088961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.089652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.091440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 901/1814] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:11 2022] DELETE /identity/v3/projects/6362ab95b61d40738d59b750d26e4286 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:12.095362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:12.096788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:12.110673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e934-006c-46b3-8479-09406def35f0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:12.177057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:12.177957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:12.178250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:12.178594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] PATH_INFO: `/v3/users/c47c30e4e1554e4dbdb1423637e33461` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:12.180162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47c30e4e1554e4dbdb1423637e33461)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:12.182214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:12.398687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47c30e4e1554e4dbdb1423637e33461'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.494348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47c30e4e1554e4dbdb1423637e33461'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.508602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47c30e4e1554e4dbdb1423637e33461'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.509336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47c30e4e1554e4dbdb1423637e33461'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.517104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47c30e4e1554e4dbdb1423637e33461'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:12.524073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 914/1815] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:12 2022] DELETE /identity/v3/users/c47c30e4e1554e4dbdb1423637e33461 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:12.630569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:12.632687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:12.645413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b76731-dd25-4878-92b6-839145bca17d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:12.705630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:12.706554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:12.706837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:12.707116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] PATH_INFO: `/v3/users/51917fdf26ee4f8a8fffec995002394c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:12.708350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51917fdf26ee4f8a8fffec995002394c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:12.711282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:12.785596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:12.787384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:12.814883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625f8f-b236-4f80-a32a-32ecab4ec76e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:12.820146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:12.821280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:12.821597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:12.821872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] PATH_INFO: `/v3/users/169f89a5d52b47bdacde1a25475ffde6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:12.823110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169f89a5d52b47bdacde1a25475ffde6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:12.825095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.017311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51917fdf26ee4f8a8fffec995002394c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.196874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51917fdf26ee4f8a8fffec995002394c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.211683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169f89a5d52b47bdacde1a25475ffde6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.212190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51917fdf26ee4f8a8fffec995002394c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.212483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51917fdf26ee4f8a8fffec995002394c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.213163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51917fdf26ee4f8a8fffec995002394c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.225160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 902/1816] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:12 2022] DELETE /identity/v3/users/51917fdf26ee4f8a8fffec995002394c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:13.228800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.228800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.288380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169f89a5d52b47bdacde1a25475ffde6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.289877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417e1d-2efc-409a-bf75-2c7b2016d194 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:13.294770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:13.295632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.295915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.296182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] PATH_INFO: `/v3/projects/e5fb47def95643cb8475d552a82f8236` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.297464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fb47def95643cb8475d552a82f8236)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:13.299423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.306169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169f89a5d52b47bdacde1a25475ffde6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.306169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169f89a5d52b47bdacde1a25475ffde6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.312322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-42be8d62-fe6d-48d7-9155-b8625f5abb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169f89a5d52b47bdacde1a25475ffde6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.319137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 915/1817] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:12 2022] DELETE /identity/v3/users/169f89a5d52b47bdacde1a25475ffde6 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:13.320335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd2bf7-5ccf-4c8c-b26c-cca4282f5fb5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.320857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd2bf7-5ccf-4c8c-b26c-cca4282f5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.321219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd2bf7-5ccf-4c8c-b26c-cca4282f5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.340947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a1cd2bf7-5ccf-4c8c-b26c-cca4282f5fb5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:13.342179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a1cd2bf7-5ccf-4c8c-b26c-cca4282f5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.427136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fb47def95643cb8475d552a82f8236', 'request_id': 'req-99a9b3e8-aa03-4b35-914e-538e72fffff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.428756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 916/1818] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:13.430240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5d6f-f243-454c-9ebb-f937a28174a5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.430534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5d6f-f243-454c-9ebb-f937a28174a5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.430869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5d6f-f243-454c-9ebb-f937a28174a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.433971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fb47def95643cb8475d552a82f8236', 'request_id': 'req-99a9b3e8-aa03-4b35-914e-538e72fffff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.444862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fb47def95643cb8475d552a82f8236', 'request_id': 'req-99a9b3e8-aa03-4b35-914e-538e72fffff6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.460687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-02dc5d6f-f243-454c-9ebb-f937a28174a5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:13.462476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-02dc5d6f-f243-454c-9ebb-f937a28174a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.537944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] The token cache is being invalidate because project e5fb47def95643cb8475d552a82f8236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:13.537944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.538266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:13.540409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 903/1819] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:13 2022] DELETE /identity/v3/projects/e5fb47def95643cb8475d552a82f8236 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:13.546591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.546591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.552929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 917/1820] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:13.554296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.555167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.555588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.575773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:13.577210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.586393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 918/1821] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:13.586985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.588219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.611261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9b3e8-aa03-4b35-914e-538e72fffff6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:13.618232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:13.618232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.618232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.618876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.621159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.637485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:13.638847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6935bc-b88e-4364-91c3-fac71cdad123 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.651499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ac42-0d93-420e-bbfd-7b5d8cb67557 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:13.656144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:13.656998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.657374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.664265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.664410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 904/1822] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:13.664410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.664410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.664410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.674874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:13.678226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.681877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:13.683093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:13.694256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 905/1823] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:13.694640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 919/1824] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:13.700139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.711014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49163c5-0236-4074-a152-a37da58fb070 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:13.716523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:13.717425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.717739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.718015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.718820 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:13.719123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:13.721338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.741062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 906/1825] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:13.743110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.758378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398ef3-edf8-4bc3-bc8f-dc802ef25c5f service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:13.764948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:13.765696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:13.765985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:13.766292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:13.767629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:13.770251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:13.916311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 920/1826] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:13.917628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:13.928933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc440a-faac-471b-b3d2-40cde3a6ae5e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.002562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.003961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.004636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.005106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.006033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.008448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.181480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 907/1827] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:13 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:14.186000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.205219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69502dda-d661-4c7b-9606-c557b00be817 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.238088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.239894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.252433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.252433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.252433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.252433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.276959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 921/1828] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:14.282515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.308382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdfa43-ec5b-47c4-a500-a51026444df0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.316083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.317028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.317862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.318608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.325208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.325208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.335330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 908/1829] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:14.339920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.360635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274eef-8f3b-4e48-b68f-8589065fdf88 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.365834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.366880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.367418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.368026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] PATH_INFO: `/v3/projects/03f1f736bbeb4027bb320d9b57b4f2e8/users/d887d488f2334cd08e1cdf76122441cb/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.388974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f1f736bbeb4027bb320d9b57b4f2e8, user_id=d887d488f2334cd08e1cdf76122441cb, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.391812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.412000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.415512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:14.435427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbced9f-0807-44d7-9359-f976d2c205c5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.447875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.447875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.447875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.447875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] PATH_INFO: `/v3/projects/f51d3bcbeec744fd8187f4d9905855fd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.466251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51d3bcbeec744fd8187f4d9905855fd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.468470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.520877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 922/1830] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:14 2022] PUT /identity/v3/projects/03f1f736bbeb4027bb320d9b57b4f2e8/users/d887d488f2334cd08e1cdf76122441cb/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:14.523878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.533122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:14.600857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51d3bcbeec744fd8187f4d9905855fd', 'request_id': 'req-9ea92508-61fd-40d6-9252-e8fea0d5214b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.608674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51d3bcbeec744fd8187f4d9905855fd', 'request_id': 'req-9ea92508-61fd-40d6-9252-e8fea0d5214b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.615678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2773c-4b96-4a95-9200-9f6fcfd81c77 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.616534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51d3bcbeec744fd8187f4d9905855fd', 'request_id': 'req-9ea92508-61fd-40d6-9252-e8fea0d5214b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.694146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.695019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.696002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.696288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] PATH_INFO: `/v3/projects/0b61c13b60e04851ab9928df7b22d47f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.697553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b61c13b60e04851ab9928df7b22d47f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.699659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.700717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] The token cache is being invalidate because project f51d3bcbeec744fd8187f4d9905855fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:14.701014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.701692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9ea92508-61fd-40d6-9252-e8fea0d5214b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.703485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 909/1831] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:14 2022] DELETE /identity/v3/projects/f51d3bcbeec744fd8187f4d9905855fd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:14.707031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.709725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.709725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.738405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] MFA Rules not processed for user `d887d488f2334cd08e1cdf76122441cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:14.738405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:14.800069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 910/1832] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:14.800980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.802278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:14.815582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252c31-e2f8-428b-8496-3559c3a4646d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.818929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b61c13b60e04851ab9928df7b22d47f', 'request_id': 'req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.823967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b61c13b60e04851ab9928df7b22d47f', 'request_id': 'req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.829881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b61c13b60e04851ab9928df7b22d47f', 'request_id': 'req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.869557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.870445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.870726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.871002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] PATH_INFO: `/v3/users/8d456acbbcf844ec9eecce8e415f7184` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.872201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d456acbbcf844ec9eecce8e415f7184)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.874158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:14.904936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] The token cache is being invalidate because project 0b61c13b60e04851ab9928df7b22d47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:14.905245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.905966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:14.907604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 923/1833] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:14 2022] DELETE /identity/v3/projects/0b61c13b60e04851ab9928df7b22d47f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:14.908313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:14.909613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:14.921943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8e80b-b81d-4e9d-b75b-a62c0dbc802e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:14.926434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:14.927059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:14.927337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:14.927607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:14.928280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:14.930330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:15.060784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 924/1834] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:14 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:15.061693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:15.063233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:15.125953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450750-e5f4-437d-8b8c-280d74c609a9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:15.130590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:15.131435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:15.131715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:15.132125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] PATH_INFO: `/v3/users/5031224af1d249b8a0d29ee24e86d5f1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:15.133951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5031224af1d249b8a0d29ee24e86d5f1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:15.135861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:15.285371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d456acbbcf844ec9eecce8e415f7184'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.505641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d456acbbcf844ec9eecce8e415f7184'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.517970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d456acbbcf844ec9eecce8e415f7184'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.520550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d456acbbcf844ec9eecce8e415f7184'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.520550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d456acbbcf844ec9eecce8e415f7184'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.531670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 911/1835] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:14 2022] DELETE /identity/v3/users/8d456acbbcf844ec9eecce8e415f7184 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:15.532693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:15.534063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:15.591670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5031224af1d249b8a0d29ee24e86d5f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.642608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9de71-e8f1-4bc9-865d-3d3811f43359 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:15.650239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:15.650998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:15.651341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:15.651717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:15.652878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:15.655367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:15.717003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5031224af1d249b8a0d29ee24e86d5f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.730759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5031224af1d249b8a0d29ee24e86d5f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.731548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5031224af1d249b8a0d29ee24e86d5f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.739239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5031224af1d249b8a0d29ee24e86d5f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:15.746005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 925/1836] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:15 2022] DELETE /identity/v3/users/5031224af1d249b8a0d29ee24e86d5f1 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:15.785092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 912/1837] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:15 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:15.786126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:15.787826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:15.881055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee079426-139a-4e9d-bf89-c3c9179dcef9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:15.887134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:15.899918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:15.900209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:15.900957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:15.901250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:15.915375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:15.929607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 926/1838] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:15.931642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:15.943937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8d7d-3dbc-43bf-944e-8496fb981840 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:15.949598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:15.950522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:15.951122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:15.951122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:15.951795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:15.953502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27014413-3063-42df-8d32-9c2496a05760 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:15.965160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 913/1839] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:05:15.968827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:15.979890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f76d6-4187-4762-afb8-9f0b7308ad71 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:15.984783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:15.985929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:15.986223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:15.986508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] PATH_INFO: `/v3/projects/cdec7d336572421eb83897cdb4c1bbd7/users/0c35d832961848a0acd9d6b7ae8db2e4/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.006798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdec7d336572421eb83897cdb4c1bbd7, user_id=0c35d832961848a0acd9d6b7ae8db2e4, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.008770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.106529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 927/1840] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:15 2022] PUT /identity/v3/projects/cdec7d336572421eb83897cdb4c1bbd7/users/0c35d832961848a0acd9d6b7ae8db2e4/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:16.119554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.119848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.120190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.136684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.138999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.157001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] MFA Rules not processed for user `0c35d832961848a0acd9d6b7ae8db2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:16.161754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.217878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378507f-c71c-4354-8663-bf47d10fc5bb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.222756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.223609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.223889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.224159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] PATH_INFO: `/v3/projects/60656465a46945069ff46ab0cd3e05c6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.225325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60656465a46945069ff46ab0cd3e05c6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.227468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.229125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 914/1841] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:16.233207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.244181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0315a-6c23-4cc5-bcad-34245f3ce1cd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.249086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.249402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.249715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.249994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.250704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.252724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.334311 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60656465a46945069ff46ab0cd3e05c6', 'request_id': 'req-0f222658-907c-4db7-9a9b-110ed5f6d065'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.341081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60656465a46945069ff46ab0cd3e05c6', 'request_id': 'req-0f222658-907c-4db7-9a9b-110ed5f6d065'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.341795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 915/1842] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:16.342625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.344261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.349692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60656465a46945069ff46ab0cd3e05c6', 'request_id': 'req-0f222658-907c-4db7-9a9b-110ed5f6d065'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.408645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672514c-0007-4e69-b836-e12a82afb83d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.413478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.414317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.414594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.416707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] PATH_INFO: `/v3/projects/2ed4d8d985c645388ec1a4052253fffd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.417526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed4d8d985c645388ec1a4052253fffd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.421010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.421221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] The token cache is being invalidate because project 60656465a46945069ff46ab0cd3e05c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:16.421221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.421870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.423654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 928/1843] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:16 2022] DELETE /identity/v3/projects/60656465a46945069ff46ab0cd3e05c6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:16.424339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.427233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.511684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222658-907c-4db7-9a9b-110ed5f6d065 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.516838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.517768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.518432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.518432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.519178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.521223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec817-d554-4fbb-8b97-e4bd035e60b7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.621540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed4d8d985c645388ec1a4052253fffd', 'request_id': 'req-10629858-5627-465c-92d2-306fae1a89b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.627683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed4d8d985c645388ec1a4052253fffd', 'request_id': 'req-10629858-5627-465c-92d2-306fae1a89b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.633684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed4d8d985c645388ec1a4052253fffd', 'request_id': 'req-10629858-5627-465c-92d2-306fae1a89b1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.663235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 929/1844] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:16.663235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.663235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.663235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.681155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:16.682518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.750870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 930/1845] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:16.750870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.758291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d3fe-f95d-4575-b6b6-9a697d440568 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.767137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.770530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.770530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.770530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.770530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.770962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f778c1-8b84-42d9-b28c-151527687275 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.771205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] The token cache is being invalidate because project 2ed4d8d985c645388ec1a4052253fffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:16.771877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.773832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-10629858-5627-465c-92d2-306fae1a89b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:16.775813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 916/1846] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:16 2022] DELETE /identity/v3/projects/2ed4d8d985c645388ec1a4052253fffd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:16.777830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337973-451d-4176-9539-bdbdb59fc144 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.778268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337973-451d-4176-9539-bdbdb59fc144 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.778896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337973-451d-4176-9539-bdbdb59fc144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.782326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 931/1847] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:16.784039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.784402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.784767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.802728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:16.803227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-63337973-451d-4176-9539-bdbdb59fc144 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:16.804225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.804992 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-63337973-451d-4176-9539-bdbdb59fc144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.813463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 932/1848] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:16.821083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 917/1849] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:16.821190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.821190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.823469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.830286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.830286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.830787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6253f3-eb68-4538-96c1-d1462b7ebb70 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.838242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.839162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.839443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.839717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] PATH_INFO: `/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8/users/08e640660bad4283bf8a508a42bfc2cc/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.845302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:16.846548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:16.856176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbd8756744048b683bc5dfbd9d0f7c8, user_id=08e640660bad4283bf8a508a42bfc2cc, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.856316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 918/1850] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:16.857107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.859030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.866526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fbdee-9bfd-415f-a018-b82f7d33c4d0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.871808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.872457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.872725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.873006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.873814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:16.874070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.878012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.886907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 919/1851] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:16.887667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.896659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a5db-2a58-4db8-9dac-046fdb5ad384 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.901297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.901924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.902207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.902498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.903193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:16.906643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.906643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:16.917048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 920/1852] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:16.917828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.926781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da627cdf-04fd-4605-be3d-a91e1df4bab9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:16.934825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 933/1853] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:16 2022] PUT /identity/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8/users/08e640660bad4283bf8a508a42bfc2cc/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:16.941362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:16.942029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:16.942141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:16.942486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:16.942671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:16.943363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:16.945325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.004883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa80ed-a690-487e-aa18-46a1aeebe029 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.009872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.010628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.010932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.011206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.011889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.014082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.021299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 921/1854] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:17.022265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.090215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b79e1-d073-4841-8226-25eabb5445ff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.095897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.096892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.097253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.097564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.098485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.100098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.107637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 934/1855] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:16 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:17.108339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.119254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 922/1856] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:17.120072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.131081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b046-b931-4fdb-9eea-17a398794a41 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.180511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7224a-b99c-42a1-96eb-109f1f154576 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.185993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.186694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.186979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.187320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.188057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.190066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.190213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.190875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.191287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.191572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.192310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.194477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.268238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 935/1857] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:17.268238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.275419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ecb-e08f-4ef8-867b-ed2e0303f6b8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.280075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.280941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.281230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.281549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] PATH_INFO: `/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8/users/08e640660bad4283bf8a508a42bfc2cc/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.283585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbd8756744048b683bc5dfbd9d0f7c8, user_id=08e640660bad4283bf8a508a42bfc2cc, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.286409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.289408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 923/1858] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:17.290358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.299330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 936/1859] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:17 2022] PUT /identity/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8/users/08e640660bad4283bf8a508a42bfc2cc/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:17.300267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.302148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395972e-d0b0-4254-a3a8-78cb4debf4eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.358150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.358854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.359135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.359409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.360129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.362403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343cda-da61-40fe-870a-5f5ff87b9831 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.372449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba1e1-d22e-440f-b9c5-c240e3871fae admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.372611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 924/1860] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:17.373776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.374062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.374339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.377750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.378532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.378817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.379092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.379817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.381410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.392437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 937/1861] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:17.394174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.403990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d142d4-0fa7-464c-9f1e-59ce6b089e2c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.407596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] MFA Rules not processed for user `08e640660bad4283bf8a508a42bfc2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:17.408638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.408765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:17.409269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.409579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.409875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.410563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.412128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.422003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 938/1862] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:17.422887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.432968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf419ad-df4d-40f1-9b3d-a00b7a65205b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.437570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.439099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.439369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.439643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.440358 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.441993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.455595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 939/1863] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:17.455595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.464872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1661b-d809-42b0-b0f9-ebcb57f1d738 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.469389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.470269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.470550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.470830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] PATH_INFO: `/v3/projects/457c25667fa1408d93457c2b57334d29/users/880baaa95ed34f35b6d7dbfced3534cc/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.476060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 925/1864] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:17.480401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.486282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457c25667fa1408d93457c2b57334d29, user_id=880baaa95ed34f35b6d7dbfced3534cc, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.487424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d44c-c221-4606-af6e-4f7dcaa12720 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.489185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.492543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.493423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.493732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.494009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] PATH_INFO: `/v3/projects/95c7afd0e62a41e4acf197d8886ac0d1/users/dc784eae5ba54496bae9ac866622bed3/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.508871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c7afd0e62a41e4acf197d8886ac0d1, user_id=dc784eae5ba54496bae9ac866622bed3, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.511602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd1bb-e512-4c65-8af7-a971f2710fd1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.648725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 940/1865] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:17 2022] PUT /identity/v3/projects/457c25667fa1408d93457c2b57334d29/users/880baaa95ed34f35b6d7dbfced3534cc/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:17.649947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.651847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:17.731435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609134-99bd-44ec-8212-976a39e2bdd8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.736872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.737696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.738091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.738460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.761280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 926/1866] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:17 2022] PUT /identity/v3/projects/95c7afd0e62a41e4acf197d8886ac0d1/users/dc784eae5ba54496bae9ac866622bed3/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:17.761280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.761280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.761280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.800515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] MFA Rules not processed for user `880baaa95ed34f35b6d7dbfced3534cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:17.801737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:17.825549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.827369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d915adf-ec66-48b5-94dc-7d613631d1b2 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:17.839542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 941/1867] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:17.841004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3949-f973-408a-92ac-2843f09f89ac None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.841299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3949-f973-408a-92ac-2843f09f89ac None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.841629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3949-f973-408a-92ac-2843f09f89ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.879870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a8ce3949-f973-408a-92ac-2843f09f89ac None None] MFA Rules not processed for user `dc784eae5ba54496bae9ac866622bed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:17.884925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a8ce3949-f973-408a-92ac-2843f09f89ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:17.885169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 927/1868] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:17.889574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.968208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 942/1869] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:17.969685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48202-ee2f-4cd7-b2f2-e629ea3f57a3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.970031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48202-ee2f-4cd7-b2f2-e629ea3f57a3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.970349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec48202-ee2f-4cd7-b2f2-e629ea3f57a3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.972439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 943/1870] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:05:17.973153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec48202-ee2f-4cd7-b2f2-e629ea3f57a3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:17.990387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc9c37-c293-4981-ac0f-4058820e0741 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:17.995394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:17.996057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:17.996335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:17.996675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:17.997358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:17.999347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565e18-143b-4fd9-aaee-d56d00eb540f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.052446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec48202-ee2f-4cd7-b2f2-e629ea3f57a3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.059943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.060579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.060865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.061139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.061856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.063794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.161221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 928/1871] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:18.161221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.161221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.161221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.180982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:18.182725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:18.220620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 944/1872] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:17 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:18.222814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.225290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:18.266509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 929/1873] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:05:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:18.267364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.337892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96229-dfdf-49f0-b300-325170ec2297 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.341712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.342361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.342643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.342918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.344735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:18.356853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc565-60fa-4ae5-a75f-9e4c5abdec7e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.422327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.424687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.440926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.442222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.442515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.442929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.443683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.446403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.447748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 945/1874] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:18.450189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.473129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6924d-1983-4dd3-a0e4-e7870eedb1ac service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.478793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.479896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.479896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.480109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.480702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.482667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.573823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 930/1875] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:18 2022] POST /identity/v3/users => generated 300 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:18.574838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.576377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:18.612659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 946/1876] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:18 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:18.612659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.628364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44ec23-a5ed-4101-aa78-f2c543a4e2d0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.641932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.642614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.642899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.643180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.643916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.645562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.663374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e647-9cc8-4701-8701-de40643ac312 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.666410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 947/1877] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:18.667652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.671509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.672179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.672488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.672784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.683938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.684957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9bfe7-0d6f-434e-9700-a2c544ac898d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.685999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.690474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.691060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.691351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.691629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.692364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.694250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.699346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 931/1878] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:18.700279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.708132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 948/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:18.714511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.715932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25fa31-e799-4428-95ec-fdbeff446a6f service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.727479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691865-4d56-41de-a2a4-169918672283 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.730196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.731110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.732094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.732364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] PATH_INFO: `/v3/projects/27a2a345ddbb459ba182074d0a294cb2/users/299b55aeeef54fe9bb1b2f1cf7693cf7/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.733865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.735588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.735935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.736304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] PATH_INFO: `/v3/projects/bf8a6eb4502e43e49061a117a383251d/users/0daed1f2dd4540d4b33891d9a6c65c35/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.751467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a2a345ddbb459ba182074d0a294cb2, user_id=299b55aeeef54fe9bb1b2f1cf7693cf7, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.752606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8a6eb4502e43e49061a117a383251d, user_id=0daed1f2dd4540d4b33891d9a6c65c35, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.755054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.755620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.840095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 949/1880] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:18 2022] PUT /identity/v3/projects/bf8a6eb4502e43e49061a117a383251d/users/0daed1f2dd4540d4b33891d9a6c65c35/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:18.843920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.876875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 932/1881] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:18 2022] PUT /identity/v3/projects/27a2a345ddbb459ba182074d0a294cb2/users/299b55aeeef54fe9bb1b2f1cf7693cf7/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:18.878556 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.952422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ecf2-5917-491f-a7b1-3d5c85784ec7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.959962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1f5-88d1-4e3a-878b-1fdb37e2fe2e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:18.966349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.967005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.967406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.967780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.968642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.970775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.973355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:18.974183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:18.974403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:18.974674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:18.975496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:18.978167 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:18.987467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 933/1882] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:18.990812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 950/1883] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:05:18.994825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:18.995511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:19.011809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a87754-65b3-4038-88d9-2845a18d527f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.012770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993665fe-b504-4270-940d-126941d29cd8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.018206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.019565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.019692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.019956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.020066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.020346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] PATH_INFO: `/v3/projects/bf8a6eb4502e43e49061a117a383251d/users/0daed1f2dd4540d4b33891d9a6c65c35/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.020792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.021212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] PATH_INFO: `/v3/projects/27a2a345ddbb459ba182074d0a294cb2/users/299b55aeeef54fe9bb1b2f1cf7693cf7/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.023278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8a6eb4502e43e49061a117a383251d, user_id=0daed1f2dd4540d4b33891d9a6c65c35, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.024041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a2a345ddbb459ba182074d0a294cb2, user_id=299b55aeeef54fe9bb1b2f1cf7693cf7, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.027129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ef33-4ec3-4533-b1ee-745e1e7cca67 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.027867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0372eb9-be91-4bca-b5cf-b5d54a885960 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.043245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 934/1884] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:18 2022] PUT /identity/v3/projects/27a2a345ddbb459ba182074d0a294cb2/users/299b55aeeef54fe9bb1b2f1cf7693cf7/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:19.046251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 951/1885] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:18 2022] PUT /identity/v3/projects/bf8a6eb4502e43e49061a117a383251d/users/0daed1f2dd4540d4b33891d9a6c65c35/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:19.056118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.056118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.056118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.067375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.067992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.067992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.107902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] MFA Rules not processed for user `299b55aeeef54fe9bb1b2f1cf7693cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:19.109932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:19.128302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] MFA Rules not processed for user `0daed1f2dd4540d4b33891d9a6c65c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:19.129615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:19.220530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 935/1886] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:19.227839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:19.262889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 952/1887] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:19.288301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:19.315859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c66153-c14d-4357-946a-89f45b5d0eab None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.323151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.323814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.324094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.324368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.341954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.344040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.359745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 936/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:19.367903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9392-3b27-4295-81ef-cdba0c29f41e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.373287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.374000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.374284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.374663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.388567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.390783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.406665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 953/1889] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:19.529074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:19.643498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:19.644405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4a34-9d3a-41bd-a1e6-8f613df05c7e service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.649891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.650801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.651547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.651655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] PATH_INFO: `/v3/users/880baaa95ed34f35b6d7dbfced3534cc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.653950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=880baaa95ed34f35b6d7dbfced3534cc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.655868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a444e-200a-43f9-a955-4ebc972b4dde service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:19.656086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.662124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:19.663096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:19.663527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:19.663818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] PATH_INFO: `/v3/users/dc784eae5ba54496bae9ac866622bed3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:19.665170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc784eae5ba54496bae9ac866622bed3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:19.667349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:19.941703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc784eae5ba54496bae9ac866622bed3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:19.943818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880baaa95ed34f35b6d7dbfced3534cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.030534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc784eae5ba54496bae9ac866622bed3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.043157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc784eae5ba54496bae9ac866622bed3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.043896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc784eae5ba54496bae9ac866622bed3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.051289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ba886aab-1cb3-4cef-b7eb-8f3fcb0397bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc784eae5ba54496bae9ac866622bed3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.061386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 954/1890] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:19 2022] DELETE /identity/v3/users/dc784eae5ba54496bae9ac866622bed3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:20.065831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:20.066121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:20.066442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:20.083774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:20.085101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:20.150827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880baaa95ed34f35b6d7dbfced3534cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.167816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880baaa95ed34f35b6d7dbfced3534cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.168562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880baaa95ed34f35b6d7dbfced3534cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.170374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a3f9e5cf-59ca-485f-b3d9-e115a4bafaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880baaa95ed34f35b6d7dbfced3534cc'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:20.182256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 955/1891] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:20.189745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:20.191286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:20.229509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 937/1892] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:19 2022] DELETE /identity/v3/users/880baaa95ed34f35b6d7dbfced3534cc => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:20.233785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:20.234072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:20.234351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:20.252598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:20.253913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:20.258806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bfa5a-15bb-493a-8ec3-922855985d55 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:20.316987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:20.317879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:20.318349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:20.318732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:20.325465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 938/1893] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:20.329739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:20.331640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:20.342534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:20.347805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 956/1894] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:05:20.352770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ba14d-ab2a-4d37-95b2-402061c73d62 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:20.356881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:20.357834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:20.358326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:20.358787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:20.373006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:20.375177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:20.389584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 939/1895] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:21.026719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:21.028348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:21.041851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572eb74-dc0b-4d66-9e77-438f889f290f service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:21.047389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:21.048258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:21.048545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:21.048818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] PATH_INFO: `/v3/projects/95c7afd0e62a41e4acf197d8886ac0d1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:21.050109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c7afd0e62a41e4acf197d8886ac0d1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:21.052265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:21.074451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:21.076636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:21.091698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de4f7e-debb-4ecb-aa11-e58c569f14f9 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:21.097083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:21.097993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:21.098270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:21.098615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] PATH_INFO: `/v3/projects/457c25667fa1408d93457c2b57334d29` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:21.099762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457c25667fa1408d93457c2b57334d29)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:21.102230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:21.199161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c7afd0e62a41e4acf197d8886ac0d1', 'request_id': 'req-359747a6-038b-4483-bca4-5128c89a3a04'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.207088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c7afd0e62a41e4acf197d8886ac0d1', 'request_id': 'req-359747a6-038b-4483-bca4-5128c89a3a04'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.215247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c7afd0e62a41e4acf197d8886ac0d1', 'request_id': 'req-359747a6-038b-4483-bca4-5128c89a3a04'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.247745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457c25667fa1408d93457c2b57334d29', 'request_id': 'req-a638768a-b03b-43d7-9ffd-9bebc0187f42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.255639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457c25667fa1408d93457c2b57334d29', 'request_id': 'req-a638768a-b03b-43d7-9ffd-9bebc0187f42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.264784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457c25667fa1408d93457c2b57334d29', 'request_id': 'req-a638768a-b03b-43d7-9ffd-9bebc0187f42'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.374567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] The token cache is being invalidate because project 95c7afd0e62a41e4acf197d8886ac0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:21.379987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.381608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.386480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 957/1896] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:21 2022] DELETE /identity/v3/projects/95c7afd0e62a41e4acf197d8886ac0d1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:21.388004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:21.397116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:21.442014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] The token cache is being invalidate because project 457c25667fa1408d93457c2b57334d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:21.442645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.443484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.446464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 940/1897] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:21 2022] DELETE /identity/v3/projects/457c25667fa1408d93457c2b57334d29 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:21.450334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:21.453149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:21.518287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359747a6-038b-4483-bca4-5128c89a3a04 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:21.555108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638768a-b03b-43d7-9ffd-9bebc0187f42 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:21.560933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:21.563638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:21.563977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:21.567878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] PATH_INFO: `/v3/users/299b55aeeef54fe9bb1b2f1cf7693cf7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:21.569538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] RBAC: Authorizing `identity:delete_user(user_id=299b55aeeef54fe9bb1b2f1cf7693cf7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:21.573478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:21.659135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:21.660075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:21.660535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:21.660819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] PATH_INFO: `/v3/users/0daed1f2dd4540d4b33891d9a6c65c35` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:21.662067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0daed1f2dd4540d4b33891d9a6c65c35)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:21.667081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:21.773880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299b55aeeef54fe9bb1b2f1cf7693cf7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.905052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299b55aeeef54fe9bb1b2f1cf7693cf7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.920463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0daed1f2dd4540d4b33891d9a6c65c35'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.921062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299b55aeeef54fe9bb1b2f1cf7693cf7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.932405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299b55aeeef54fe9bb1b2f1cf7693cf7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.933039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299b55aeeef54fe9bb1b2f1cf7693cf7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:21.951103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 941/1898] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:21 2022] DELETE /identity/v3/users/299b55aeeef54fe9bb1b2f1cf7693cf7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:22.036919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0daed1f2dd4540d4b33891d9a6c65c35'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.051875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0daed1f2dd4540d4b33891d9a6c65c35'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.052591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0daed1f2dd4540d4b33891d9a6c65c35'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.061769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0daed1f2dd4540d4b33891d9a6c65c35'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.074598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 958/1899] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:21 2022] DELETE /identity/v3/users/0daed1f2dd4540d4b33891d9a6c65c35 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:22.570052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:22.572202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:22.638172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:22.639552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:22.640156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1e20-e214-4b68-8480-93732e10164d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:22.699337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:22.700113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:22.700391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:22.700663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] PATH_INFO: `/v3/projects/27a2a345ddbb459ba182074d0a294cb2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:22.701885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a2a345ddbb459ba182074d0a294cb2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:22.703908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:22.705829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0a53-2504-4862-86d9-1972a86554c0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:22.711130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:22.711985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:22.712268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:22.712546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] PATH_INFO: `/v3/projects/bf8a6eb4502e43e49061a117a383251d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:22.713819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf8a6eb4502e43e49061a117a383251d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:22.715751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:22.833364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a2a345ddbb459ba182074d0a294cb2', 'request_id': 'req-3eb0362b-0389-4da3-90f6-f68b7275c022'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.842399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a2a345ddbb459ba182074d0a294cb2', 'request_id': 'req-3eb0362b-0389-4da3-90f6-f68b7275c022'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.848907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8a6eb4502e43e49061a117a383251d', 'request_id': 'req-e3e2c051-9134-42b5-8ff8-682251650b92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.849931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a2a345ddbb459ba182074d0a294cb2', 'request_id': 'req-3eb0362b-0389-4da3-90f6-f68b7275c022'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.856806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8a6eb4502e43e49061a117a383251d', 'request_id': 'req-e3e2c051-9134-42b5-8ff8-682251650b92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.866884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8a6eb4502e43e49061a117a383251d', 'request_id': 'req-e3e2c051-9134-42b5-8ff8-682251650b92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.916649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] The token cache is being invalidate because project 27a2a345ddbb459ba182074d0a294cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:22.916961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.918177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3eb0362b-0389-4da3-90f6-f68b7275c022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.919738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 942/1900] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:22 2022] DELETE /identity/v3/projects/27a2a345ddbb459ba182074d0a294cb2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:22.924445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02406-0ea7-41ca-b3cc-1c5074691d05 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:22.924729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02406-0ea7-41ca-b3cc-1c5074691d05 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:22.925005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da02406-0ea7-41ca-b3cc-1c5074691d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:22.952172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2da02406-0ea7-41ca-b3cc-1c5074691d05 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:22.953502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2da02406-0ea7-41ca-b3cc-1c5074691d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:22.984978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] The token cache is being invalidate because project bf8a6eb4502e43e49061a117a383251d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:22.985264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.986980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e3e2c051-9134-42b5-8ff8-682251650b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:22.990634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 959/1901] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:22 2022] DELETE /identity/v3/projects/bf8a6eb4502e43e49061a117a383251d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:22.999469 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5688-325f-43e4-b1b2-7a40d535a02e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:22.999773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5688-325f-43e4-b1b2-7a40d535a02e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.000058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c5688-325f-43e4-b1b2-7a40d535a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.019627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fe9c5688-325f-43e4-b1b2-7a40d535a02e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.020934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fe9c5688-325f-43e4-b1b2-7a40d535a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.023630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 943/1902] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:23.029537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 960/1903] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:23.032377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.032763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.033146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.036753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.037042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.037611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.051704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.052892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.057068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.058411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.061272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 944/1904] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:23.065299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.066694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 961/1905] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:23.070764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.074286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234af94-1fb8-4890-88b2-9a8b7b72cdb6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.078864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.079507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.079624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c479-4ebe-41f0-ab96-9224926aed23 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.079790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.080068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.080784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:23.081087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.082721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.084327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.084958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.085244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.085593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.086324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:23.086630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.088211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.094242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 945/1906] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:05:23.098388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.099702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 962/1907] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:23.108144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.108802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f2df2-3207-45b6-b9b4-cf7bd67b691f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.114158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.114798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.115077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.115353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.116073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.118603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.119151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291762cc-4ebd-4aa5-b2ad-046b16ff412f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.123884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.124506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.124785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.125058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.125760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.127622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.219250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 946/1908] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:23.219250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.219250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.243655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 963/1909] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:23.244465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.281771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5138-9e69-4fdb-80d1-918a336ca3ef admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.307844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a17a2-5253-40b6-97bc-ff6340ae6dc9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.313779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.314458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.314904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.315196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.315891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.317849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.349055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.349055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.349055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.349055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] PATH_INFO: `/v3/users/d887d488f2334cd08e1cdf76122441cb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.350392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d887d488f2334cd08e1cdf76122441cb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.353198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.396468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 964/1910] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/users => generated 281 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:23.397411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.407165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1b70e-bc73-4c43-80cc-a8cc77b502f1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.411892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.412549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.412873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.413107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.413859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.415817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.504749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 965/1911] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:23.505606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.515488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf2e6-de63-4b33-9019-910fe19c0736 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.520096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.520766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.521052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.521342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.522083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.524209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.534514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 966/1912] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:23.535330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.539753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd887d488f2334cd08e1cdf76122441cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:23.545103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f81c3-5823-4a06-bc5e-1b98f42fbf9e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.549800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.550437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.550724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.551000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.551710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.553394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.564262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 967/1913] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:23.565279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.575191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd6188-2054-494c-9d89-6fb37609339d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.579838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.580499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.580778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.581093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.581838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.583432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.593153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 968/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:23.594024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.596214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd887d488f2334cd08e1cdf76122441cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:23.603864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3653-806e-42db-8040-012c6aaea9e7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.608646 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.609083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd887d488f2334cd08e1cdf76122441cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:23.609267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.609576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.609847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.609977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd887d488f2334cd08e1cdf76122441cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:23.610624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd887d488f2334cd08e1cdf76122441cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:23.610728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.612533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.625948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 969/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:23.625948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.627630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.632936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 947/1916] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:23 2022] DELETE /identity/v3/users/d887d488f2334cd08e1cdf76122441cb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:23.633821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.635152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.640455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455966-7fe6-42ac-8688-4e98553699e0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.697229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.698246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.698529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.698963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] PATH_INFO: `/v3/projects/13a0ef5638cd4e94b1983f0012e3096f/users/9b3c608567574e1b841821b9a167a466/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.700898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b556-821f-4afa-84e2-39ddd1b8ad95 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.706112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.707358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.707358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.707564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] PATH_INFO: `/v3/projects/e9bab58ecb3843858828968064dd7878/users/961783e6d31c442ba3488dae80355e29/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.719205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a0ef5638cd4e94b1983f0012e3096f, user_id=9b3c608567574e1b841821b9a167a466, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.721989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8c5a-b088-40b1-b745-87b5b75c5c5e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.724599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9bab58ecb3843858828968064dd7878, user_id=961783e6d31c442ba3488dae80355e29, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.727879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d5949-9d38-480e-91ea-27b4ab56153a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.796656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 970/1917] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:23 2022] PUT /identity/v3/projects/13a0ef5638cd4e94b1983f0012e3096f/users/9b3c608567574e1b841821b9a167a466/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:23.797974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346800-090f-4393-bf34-94020395dd39 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.798291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346800-090f-4393-bf34-94020395dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.798567 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d346800-090f-4393-bf34-94020395dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.817037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 948/1918] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:23 2022] PUT /identity/v3/projects/e9bab58ecb3843858828968064dd7878/users/961783e6d31c442ba3488dae80355e29/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:23.817037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.817037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.817037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.818568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0d346800-090f-4393-bf34-94020395dd39 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.819996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d346800-090f-4393-bf34-94020395dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.842370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] MFA Rules not processed for user `9b3c608567574e1b841821b9a167a466`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.843552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.877688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 971/1919] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:23.878965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.879251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.879527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.896740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:23.898003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.905735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 972/1920] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:23.906508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.907758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.914618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 949/1921] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:23.918240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:23.920355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:23.971300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192e2af-9ca9-4035-88d1-f52bbf237d0c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:23.979758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:23.979758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:23.979758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:23.979758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:23.989753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:23.991531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:23.997262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54839e-2315-4e29-985d-9df85a9f4b09 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:24.001266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:24.001999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:24.002206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:24.002484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:24.003451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 973/1922] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:24.004141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:24.005557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:24.012736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:24.014222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:24.026436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 950/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:05:24.069795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad4fe7-5ee9-4744-839d-676e1ceb1641 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:24.074237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:24.075000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:24.075386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:24.075761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:24.088503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:24.089995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a65e0-3714-468a-a1c2-9f30f2de611b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:24.099335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 974/1924] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:24.117370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:24.126782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537614-a9fb-438f-9d26-3b1028133282 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:24.133397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:24.134647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:24.135351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:24.136546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] PATH_INFO: `/v3/users/9b3c608567574e1b841821b9a167a466` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:24.139028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3c608567574e1b841821b9a167a466)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:24.142259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:24.406101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3c608567574e1b841821b9a167a466'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:24.539776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3c608567574e1b841821b9a167a466'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:24.553296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3c608567574e1b841821b9a167a466'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:24.557266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3c608567574e1b841821b9a167a466'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:24.564738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3c608567574e1b841821b9a167a466'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:24.573897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 951/1925] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:24 2022] DELETE /identity/v3/users/9b3c608567574e1b841821b9a167a466 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:24.578638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:24.579098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:24.579446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:24.598422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:24.599720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:24.692744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 975/1926] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:24.702278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:24.704230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:24.776602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb52f7-dd2d-4639-9b0f-4bc43c5dcf18 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:24.780658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:24.781334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:24.781652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:24.781935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:24.794893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:24.796289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:24.808858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 952/1927] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:24.992362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:24.994346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:25.007130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74e4a-c26b-4a0b-9bf8-1ea1dea9fa77 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:25.012728 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:25.013631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:25.013919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:25.014209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] PATH_INFO: `/v3/projects/03f1f736bbeb4027bb320d9b57b4f2e8` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:25.015404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f1f736bbeb4027bb320d9b57b4f2e8)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:25.017502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:25.158839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f1f736bbeb4027bb320d9b57b4f2e8', 'request_id': 'req-7c5c3d4e-147f-483a-bcac-f983ba59f39a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.167833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f1f736bbeb4027bb320d9b57b4f2e8', 'request_id': 'req-7c5c3d4e-147f-483a-bcac-f983ba59f39a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.174643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f1f736bbeb4027bb320d9b57b4f2e8', 'request_id': 'req-7c5c3d4e-147f-483a-bcac-f983ba59f39a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.330360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] The token cache is being invalidate because project 03f1f736bbeb4027bb320d9b57b4f2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:25.330652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.332196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.335333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 976/1928] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:24 2022] DELETE /identity/v3/projects/03f1f736bbeb4027bb320d9b57b4f2e8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:25.342714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:25.359157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd191f-bb65-4490-be04-1647e0639128 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:25.458972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:25.460006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:25.461468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:25.462450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] PATH_INFO: `/v3/users/0c35d832961848a0acd9d6b7ae8db2e4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:25.464368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c35d832961848a0acd9d6b7ae8db2e4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:25.466622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:25.703521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:25.705325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:25.732936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3d4e-147f-483a-bcac-f983ba59f39a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:25.734766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:25.735907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:25.736623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:25.737079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] PATH_INFO: `/v3/projects/13a0ef5638cd4e94b1983f0012e3096f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:25.739366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a0ef5638cd4e94b1983f0012e3096f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:25.742472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:25.766328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c35d832961848a0acd9d6b7ae8db2e4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.853407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c35d832961848a0acd9d6b7ae8db2e4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.875119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c35d832961848a0acd9d6b7ae8db2e4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.876268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c35d832961848a0acd9d6b7ae8db2e4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.877808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-4cd84a86-68b9-4bbd-92af-9b455510ac65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c35d832961848a0acd9d6b7ae8db2e4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.899195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 953/1929] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:25 2022] DELETE /identity/v3/users/0c35d832961848a0acd9d6b7ae8db2e4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:25.910664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a0ef5638cd4e94b1983f0012e3096f', 'request_id': 'req-e70fff91-2253-43dd-b0e2-87119fb0eca0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.923711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a0ef5638cd4e94b1983f0012e3096f', 'request_id': 'req-e70fff91-2253-43dd-b0e2-87119fb0eca0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:25.939194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a0ef5638cd4e94b1983f0012e3096f', 'request_id': 'req-e70fff91-2253-43dd-b0e2-87119fb0eca0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:26.076197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] The token cache is being invalidate because project 13a0ef5638cd4e94b1983f0012e3096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:26.076761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:26.077612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e70fff91-2253-43dd-b0e2-87119fb0eca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:26.079345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 977/1930] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:25 2022] DELETE /identity/v3/projects/13a0ef5638cd4e94b1983f0012e3096f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:26.086481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.086780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.087064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.107128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:26.108446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:26.185575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 954/1931] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:26.189964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.191020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.191511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.213093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:26.214433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:26.222979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 978/1932] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:26.227709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.238703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566e3d-045c-49f4-88a9-867569616e70 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.244867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.245569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.245860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.246225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.246961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:26.251945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.251945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:26.261960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 955/1933] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:05:26.266100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.276592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07c384-5058-47e6-8426-0d5a3ef3dc11 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.293766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.294643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.295060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.295597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.296488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.311562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:26.395603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 979/1934] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:26 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:26.400216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.411636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546122f-228a-4f88-bb84-f49f0ace1635 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.474696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.476023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.477731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.478132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.479002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.489662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:26.695243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 956/1935] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:26 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:26.699218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.711803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93b086-035b-4c53-b3bf-9cadec338ed2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.717324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.718055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.718466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.718746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.719666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.721879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:26.735015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 980/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:26.739238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.751564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68552379-a4eb-43ed-aaf8-b3643ba2e579 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.756540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.757928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.758384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.758662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.759418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.761068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb939-b92a-4f3a-b79a-140f00f375a7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:26.787198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:26.788422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 957/1937] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:26.797684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941eff-e705-4751-8f2b-df6df3e3bc51 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:26.802463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:26.803512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:26.803793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:26.804118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] PATH_INFO: `/v3/projects/9c3d59fa12714b06ac852218576515fb/users/e5638e7651574756ac4291ff814a8a9f/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:26.843098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3d59fa12714b06ac852218576515fb, user_id=e5638e7651574756ac4291ff814a8a9f, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:26.849544 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:27.067767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 981/1938] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:26 2022] PUT /identity/v3/projects/9c3d59fa12714b06ac852218576515fb/users/e5638e7651574756ac4291ff814a8a9f/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:27.078958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5145-e683-4428-add2-92e923ef3cf5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.079470 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5145-e683-4428-add2-92e923ef3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.079898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5145-e683-4428-add2-92e923ef3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.111000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-eb6b5145-e683-4428-add2-92e923ef3cf5 None None] MFA Rules not processed for user `e5638e7651574756ac4291ff814a8a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:27.111993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-eb6b5145-e683-4428-add2-92e923ef3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.214232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 958/1939] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:27.226145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:27.229174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.239855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.240540 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.240995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.297570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] MFA Rules not processed for user `961783e6d31c442ba3488dae80355e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:27.298886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.364735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63400dfc-a1c6-4beb-a89a-1b0dfa70d998 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:27.369635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:27.370294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.370577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.375101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.386887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:27.388528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:27.408383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 959/1941] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:27.412015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 982/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:27.413086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:27.415920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.525929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8aa73-6281-4fc9-8570-464bfde9c431 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:27.532172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:27.532858 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.533152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.533424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.534372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:27.536588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:27.564747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:27.567109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.589630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b8cc-9ecc-496e-baa3-bb3cf6ba80ee service glance] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:27.594440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:27.595534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.595961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.596387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] PATH_INFO: `/v3/projects/cdec7d336572421eb83897cdb4c1bbd7` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.598826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdec7d336572421eb83897cdb4c1bbd7)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:27.601812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:27.667349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 960/1942] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:27 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:27.668599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:27.792822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c2f13-fa60-4900-8614-520696248fb5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:27.794718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdec7d336572421eb83897cdb4c1bbd7', 'request_id': 'req-7e18b607-7272-4a16-965c-dad339f7c20b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:27.803321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdec7d336572421eb83897cdb4c1bbd7', 'request_id': 'req-7e18b607-7272-4a16-965c-dad339f7c20b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:27.810217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdec7d336572421eb83897cdb4c1bbd7', 'request_id': 'req-7e18b607-7272-4a16-965c-dad339f7c20b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:27.883548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:27.883548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:27.883548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:27.883548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:27.884340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:27.886340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:27.952699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] The token cache is being invalidate because project cdec7d336572421eb83897cdb4c1bbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:27.953008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:27.953818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:27.955447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 983/1943] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:27 2022] DELETE /identity/v3/projects/cdec7d336572421eb83897cdb4c1bbd7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:27.959756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:27.973201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:27.975966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 961/1944] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:27 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:27.992942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b607-7272-4a16-965c-dad339f7c20b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:28.001804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:28.002390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:28.002851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:28.003331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] PATH_INFO: `/v3/users/08e640660bad4283bf8a508a42bfc2cc` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:28.005105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e640660bad4283bf8a508a42bfc2cc)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:28.009619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:28.011276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:28.016507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:28.048525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5e63-8094-4e84-898e-d193d7e3a400 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:28.056185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:28.057458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:28.063334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:28.064565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:28.066266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:28.070436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:28.088412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 962/1945] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:28.093889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:28.108351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbcffe-bef7-46d9-9083-ed3c67fb6aa8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:28.117117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:28.118248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:28.125668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:28.125668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] PATH_INFO: `/v3/projects/c734cb02f2634987be53f4f20dbb123f/users/e860ef01760d4bb3a2014f8424043397/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:28.134562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c734cb02f2634987be53f4f20dbb123f, user_id=e860ef01760d4bb3a2014f8424043397, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:28.137352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:28.235200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 963/1946] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:28 2022] PUT /identity/v3/projects/c734cb02f2634987be53f4f20dbb123f/users/e860ef01760d4bb3a2014f8424043397/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:28.236766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:28.297506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e640660bad4283bf8a508a42bfc2cc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:28.340783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a706-8c8b-47ac-9366-de1fcb7206ce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:28.346696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:28.347382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:28.347669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:28.347964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:28.348747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:28.360675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:28.379972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e640660bad4283bf8a508a42bfc2cc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:28.381620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 964/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:28.382949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:28.400930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772f9f1-0138-4631-9493-340822edd33c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:28.408490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:28.409594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:28.410174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:28.410707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] PATH_INFO: `/v3/projects/c734cb02f2634987be53f4f20dbb123f/users/e860ef01760d4bb3a2014f8424043397/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:28.413219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c734cb02f2634987be53f4f20dbb123f, user_id=e860ef01760d4bb3a2014f8424043397, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:28.417135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:28.428262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e640660bad4283bf8a508a42bfc2cc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:28.430130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e640660bad4283bf8a508a42bfc2cc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:28.441949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bd07fb-307b-487d-bb9c-ee2cfda96e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e640660bad4283bf8a508a42bfc2cc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:28.448433 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 965/1948] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:28 2022] PUT /identity/v3/projects/c734cb02f2634987be53f4f20dbb123f/users/e860ef01760d4bb3a2014f8424043397/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:28.451709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 984/1949] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:27 2022] DELETE /identity/v3/users/08e640660bad4283bf8a508a42bfc2cc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:29.047685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:29.049883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:29.177585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5dfc-6a99-4d09-a712-1209d731fea9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:29.256544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:29.258232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:29.258677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:29.258952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] PATH_INFO: `/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:29.260226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbd8756744048b683bc5dfbd9d0f7c8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:29.262646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:29.408707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbd8756744048b683bc5dfbd9d0f7c8', 'request_id': 'req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:29.422078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbd8756744048b683bc5dfbd9d0f7c8', 'request_id': 'req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:29.437463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbd8756744048b683bc5dfbd9d0f7c8', 'request_id': 'req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:29.541137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] The token cache is being invalidate because project bdbd8756744048b683bc5dfbd9d0f7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:29.542164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:29.543114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1ad7a4d9-0d38-4313-8cdc-2de0d4ab5f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:29.544925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 966/1950] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:29 2022] DELETE /identity/v3/projects/bdbd8756744048b683bc5dfbd9d0f7c8 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:29.551037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:29.551597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:29.551597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:29.588145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:29.592341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:29.703531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 985/1951] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:29.712191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:29.712472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:29.712742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:29.731925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:29.733164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:29.745064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 967/1952] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:05:29.756099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:29.774120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acccca4-888c-4389-b386-61f9ab5d1605 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:29.782609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:29.783807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:29.784301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:29.784596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:29.785791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:29.786106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:29.787781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:29.801668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 986/1953] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:29.805942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:29.816524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735e5e-7dd4-4ea8-9101-5e4b1736718c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:29.823703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:29.825225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:29.825611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:29.825964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:29.826857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:29.829259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:29.932398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 968/1954] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:29 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:05:29.933596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:29.944165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6e579-1765-443e-ab38-1ac4e5887e3e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:30.042548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:30.043514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.043940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.045547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.047699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:30.050485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:30.169784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 987/1955] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:29 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:30.174118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:30.188139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee094-b291-4dbb-86cf-4516b3d46a5a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:30.206068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:30.207275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.207997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.208419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.209325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:30.211181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:30.262480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 969/1956] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:30.266923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:30.283370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658c556-9b26-427a-b248-5fa142db69d9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:30.297404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:30.298074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.298354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.298630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.299532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:30.301419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112fe72-f05d-447b-9371-1c9ff03ed17d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:30.328740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 988/1957] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:05:30.338391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:30.358860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188789-95f3-4cda-b9a0-1f6623b82990 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:30.374784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:30.376007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.376427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.381832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] PATH_INFO: `/v3/projects/9c62ac63dafd4ceeb2d331f2193de07d/users/701fe170b83e4e0a825f2602f7ccd70f/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.418066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c62ac63dafd4ceeb2d331f2193de07d, user_id=701fe170b83e4e0a825f2602f7ccd70f, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:30.424314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:30.519521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 970/1958] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:30 2022] PUT /identity/v3/projects/9c62ac63dafd4ceeb2d331f2193de07d/users/701fe170b83e4e0a825f2602f7ccd70f/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:30.532229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8e7c-f554-4c9e-af02-a1e0d96452e9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.532524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8e7c-f554-4c9e-af02-a1e0d96452e9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.532812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8e7c-f554-4c9e-af02-a1e0d96452e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.563583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f9ec8e7c-f554-4c9e-af02-a1e0d96452e9 None None] MFA Rules not processed for user `701fe170b83e4e0a825f2602f7ccd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:30.565524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f9ec8e7c-f554-4c9e-af02-a1e0d96452e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:30.654816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:30.667208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 989/1959] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:30.765805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438969-5c45-4c8f-bf2c-957c77cad3af admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:30.783157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.783963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.784332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.794183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:30.796514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:30.797702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:30.799427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:30.800437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:30.806770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:30.839007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] MFA Rules not processed for user `e860ef01760d4bb3a2014f8424043397`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:30.841148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:30.924418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 971/1960] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:30 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:30.925499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:30.997495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 990/1961] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:31.005919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.009091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:31.077273 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdf2e3-01b4-45d9-a37e-4dce6ea39ae8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.093280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.094400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.094903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.095285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.095881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.098063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.107826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096d16-b420-4d9a-8d14-abc1272d2603 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.176988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.177705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.177991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.178270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.180699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:31.231415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 972/1962] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:30 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:31.235131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.251369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ad1b-a425-44e4-a22c-12304c0a4e33 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.258269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.258876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.259155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.259431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.260216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.262280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.272733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.275635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.276769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 973/1963] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:31.281765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.287904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 991/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:05:31.293565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fcd87-1f36-4fd8-b0ea-75233c2046ff admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.305224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.306189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.307112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.307398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] PATH_INFO: `/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944/users/4705f1b9319c4ce5834f5c99f87c9f84/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.323898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcaaac2cb314dcd9448ad18bcd82944, user_id=4705f1b9319c4ce5834f5c99f87c9f84, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.326805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.428687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 974/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:31 2022] PUT /identity/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944/users/4705f1b9319c4ce5834f5c99f87c9f84/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:31.433379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.453825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fdd3-90b9-4404-9c65-05c9a378fab3 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.523146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.523852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.524139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.524415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.525138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.526949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a450-3868-4000-877d-c6db7b6ce6d1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.544763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 992/1966] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:31.546840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.560913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7554-753f-4b88-82bf-7be8c090b543 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.565897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.566725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.567013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.567291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] PATH_INFO: `/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944/users/4705f1b9319c4ce5834f5c99f87c9f84/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.569498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcaaac2cb314dcd9448ad18bcd82944, user_id=4705f1b9319c4ce5834f5c99f87c9f84, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.572183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.583014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 975/1967] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:31 2022] PUT /identity/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944/users/4705f1b9319c4ce5834f5c99f87c9f84/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:31.595010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.595530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.595618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.628266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] MFA Rules not processed for user `4705f1b9319c4ce5834f5c99f87c9f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:31.629701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:31.705141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 993/1968] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:31.716876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:31.718750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:31.784143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd40b-6fab-4cf9-84bf-71b7e860527f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:31.788188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:31.788851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:31.789137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:31.789463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:31.799725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:31.801232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48c65e-1035-44de-bd09-7ad55b96a6eb service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:31.812077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 976/1969] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:32.946716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:33.008786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b17eb-a8e2-48b8-8699-46db72d3d2a5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:33.013880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:33.016807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:33.016807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:33.016807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] PATH_INFO: `/v3/users/701fe170b83e4e0a825f2602f7ccd70f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:33.016807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=701fe170b83e4e0a825f2602f7ccd70f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:33.018594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:33.186611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701fe170b83e4e0a825f2602f7ccd70f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:33.263950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701fe170b83e4e0a825f2602f7ccd70f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:33.277064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701fe170b83e4e0a825f2602f7ccd70f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:33.277945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701fe170b83e4e0a825f2602f7ccd70f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:33.285688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701fe170b83e4e0a825f2602f7ccd70f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:33.292324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 994/1970] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:32 2022] DELETE /identity/v3/users/701fe170b83e4e0a825f2602f7ccd70f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:33.297051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:33.297554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:33.297668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:33.315113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:33.316309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:33.374531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 977/1971] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:33.384724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:33.386291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:33.447486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422e8a-fd91-4003-942e-a17504969f91 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:33.451017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:33.451660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:33.451938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:33.452207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:33.461993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:33.463423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:33.473262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 995/1972] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:05:33.923394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:33.924947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:33.937108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836972d9-c30c-45b6-b4dd-1e3c7af4f0b1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:33.941789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:33.942652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:33.942919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:33.943187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] PATH_INFO: `/v3/projects/9c62ac63dafd4ceeb2d331f2193de07d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:33.945053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c62ac63dafd4ceeb2d331f2193de07d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:33.946989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:34.058629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c62ac63dafd4ceeb2d331f2193de07d', 'request_id': 'req-6853318f-101f-4333-9331-a89a3c12ec6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.071794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c62ac63dafd4ceeb2d331f2193de07d', 'request_id': 'req-6853318f-101f-4333-9331-a89a3c12ec6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.077537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c62ac63dafd4ceeb2d331f2193de07d', 'request_id': 'req-6853318f-101f-4333-9331-a89a3c12ec6a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.156141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:34.157693 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:34.167462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] The token cache is being invalidate because project 9c62ac63dafd4ceeb2d331f2193de07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:34.167673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.168280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.169863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 978/1973] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:33 2022] DELETE /identity/v3/projects/9c62ac63dafd4ceeb2d331f2193de07d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:34.173628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:34.174928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:34.219386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d9fe-f8f5-4b58-b6d7-5ecf379c5f91 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:34.242952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853318f-101f-4333-9331-a89a3c12ec6a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:34.247713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:34.248585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:34.248860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:34.249134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] PATH_INFO: `/v3/users/4705f1b9319c4ce5834f5c99f87c9f84` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:34.250403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4705f1b9319c4ce5834f5c99f87c9f84)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:34.252372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:34.267504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:34.268143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:34.268423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:34.268700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:34.270479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:34.332207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:34.333624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:34.342923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 996/1974] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:05:34.420099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4705f1b9319c4ce5834f5c99f87c9f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.487670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4705f1b9319c4ce5834f5c99f87c9f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.503620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4705f1b9319c4ce5834f5c99f87c9f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.503620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4705f1b9319c4ce5834f5c99f87c9f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.503620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-44b4bea5-1d0e-410b-8cff-74198d6b5496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4705f1b9319c4ce5834f5c99f87c9f84'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:34.517424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 979/1975] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:05:34 2022] DELETE /identity/v3/users/4705f1b9319c4ce5834f5c99f87c9f84 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:05:34.975188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:34.986472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bf2d8-5aa7-4caa-82ab-19968ff683d2 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:35.043637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:35.044502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.044784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.045063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] PATH_INFO: `/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.046306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcaaac2cb314dcd9448ad18bcd82944)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:35.048267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:35.163626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcaaac2cb314dcd9448ad18bcd82944', 'request_id': 'req-2b3fbe35-ca57-43d6-9b55-08091eab1e57'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:35.170464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcaaac2cb314dcd9448ad18bcd82944', 'request_id': 'req-2b3fbe35-ca57-43d6-9b55-08091eab1e57'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:35.176578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcaaac2cb314dcd9448ad18bcd82944', 'request_id': 'req-2b3fbe35-ca57-43d6-9b55-08091eab1e57'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:35.503637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] The token cache is being invalidate because project bfcaaac2cb314dcd9448ad18bcd82944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:05:35.526078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:35.526078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2b3fbe35-ca57-43d6-9b55-08091eab1e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:05:35.526078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 997/1976] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:05:34 2022] DELETE /identity/v3/projects/bfcaaac2cb314dcd9448ad18bcd82944 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:35.529717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.530207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.530300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.547968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:35.549198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:35.608445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 980/1977] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:35.617140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.617453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.625159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.635593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:35.636792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:35.644613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 998/1978] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:35.648990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:35.659007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bea9b2-7bd9-4230-9b5a-fe683e8d2ff1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:35.665261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:35.665889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.666173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.666450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.667172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:05:35.667477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:35.669106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:35.682216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 981/1979] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:05:35.686582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:35.696076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde4fa-9f20-4368-835a-b845e1302074 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:35.700929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:35.701679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.701965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.702260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.702979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:35.704910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:35.791962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 999/1980] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:05:35 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:35.796235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:35.807729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503f7c-67aa-4ca4-b73e-7ad5852c2b0a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:35.871684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:35.872673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:35.873854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:35.874247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:35.875071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:35.877386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:36.003119 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 982/1981] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:05:35 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:05:36.006963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:36.017250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801a9a-9e87-48b6-887f-1f19ecc25e9a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:36.021750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:36.022944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:36.023222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:36.023496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:36.024214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:36.025826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:36.036411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1000/1982] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:36.040973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:36.050868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c691-9989-4e8f-b120-57ae5b4525ca admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:36.055372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:36.056019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:36.056296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:36.056569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:36.057282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:36.058904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd6a0-7738-423d-b5a3-6e41ed330f50 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:36.068494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 983/1983] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:05:36.072621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:36.082950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c14a-7279-46bc-b555-604a332b7467 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:36.088072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:36.089547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:36.089547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:36.089547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] PATH_INFO: `/v3/projects/8e090573abed4f19a00220b581606500/users/eae082c2581440949912de5111751f4b/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:36.104745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e090573abed4f19a00220b581606500, user_id=eae082c2581440949912de5111751f4b, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:36.107424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:36.186175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1001/1984] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:05:36 2022] PUT /identity/v3/projects/8e090573abed4f19a00220b581606500/users/eae082c2581440949912de5111751f4b/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:05:36.197154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb346af-29c8-4f59-9f72-97a6e799744a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:36.197463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb346af-29c8-4f59-9f72-97a6e799744a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:36.197743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb346af-29c8-4f59-9f72-97a6e799744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:36.224983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3cb346af-29c8-4f59-9f72-97a6e799744a None None] MFA Rules not processed for user `eae082c2581440949912de5111751f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:05:36.226210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3cb346af-29c8-4f59-9f72-97a6e799744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:36.291550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 984/1985] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:05:36.304150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:05:36.305966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:05:36.368694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5916ee-ab1f-4225-b11b-0f518d10cce7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:05:36.372374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:05:36.373015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:05:36.373296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:05:36.373682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:05:36.382708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:05:36.384181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e593c51-0bce-4aaa-a7d3-4a369876ca88 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:05:36.394409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1002/1986] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:05:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:01.834555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:01.835457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:01.835740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:01.838188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 985/1987] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:06:01.857462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:01.857462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:01.857462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:01.865760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] MFA Rules not processed for user `655db89983b446278bc27381688d2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:01.866944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:01.930549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1003/1988] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:01.941734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:01.943399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:01.959980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda1b35-a916-4666-bd8a-5e0dbf460fef None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:01.973940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:01.974608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:01.974889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:01.975164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:01.977948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:01.979434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:01.985367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:01.987261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:01.997624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 986/1989] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:02.056574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2a48-e4d6-4d29-aaf6-2fe7761fbec4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:02.056574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:02.056574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:02.056817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:02.056892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] PATH_INFO: `/v3/users/e7b48227a0dd443996039fdd00ad95b8` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:02.058092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b48227a0dd443996039fdd00ad95b8)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:02.060003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:02.252461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b48227a0dd443996039fdd00ad95b8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.320175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b48227a0dd443996039fdd00ad95b8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.333552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b48227a0dd443996039fdd00ad95b8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.334263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b48227a0dd443996039fdd00ad95b8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.341198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0d40128a-3cd7-4fe2-9e50-fe7a2bc83ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b48227a0dd443996039fdd00ad95b8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.352240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1004/1990] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:06:01 2022] DELETE /identity/v3/users/e7b48227a0dd443996039fdd00ad95b8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:02.589799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:02.600134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a3e5-6028-4314-af16-a21172b0845b service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:02.657030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:02.657956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:02.658242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:02.658518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] PATH_INFO: `/v3/projects/cdcc94a5ac0246afb333e33541f5ac2b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:02.659721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcc94a5ac0246afb333e33541f5ac2b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:02.661662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:02.763978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcc94a5ac0246afb333e33541f5ac2b', 'request_id': 'req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.769891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcc94a5ac0246afb333e33541f5ac2b', 'request_id': 'req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.775026 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcc94a5ac0246afb333e33541f5ac2b', 'request_id': 'req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.844091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] The token cache is being invalidate because project cdcc94a5ac0246afb333e33541f5ac2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:06:02.844662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.844942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c9ba1a8b-2b4a-4668-a963-a0610a7cb955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:02.846562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 987/1991] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:06:02 2022] DELETE /identity/v3/projects/cdcc94a5ac0246afb333e33541f5ac2b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:02.851681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:02.851973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:02.852281 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:02.874706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:02.875953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:02.934717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1005/1992] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:02.943508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:02.943801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:02.944084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:02.962679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:02.963857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:02.971641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 988/1993] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:02.977291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:02.987448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7751a27-399e-48bb-8043-0e1c6d82eba4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:02.991933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:02.992572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:02.992858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:02.993134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:02.993869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:06:02.994171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:02.995738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.006919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1006/1994] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:06:03.011036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.020113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e624-e66a-4b68-a389-d0a505579a3b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.025248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.025923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.026206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.026478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.027188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.029093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.114997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 989/1995] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:06:03 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:03.118993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.130894 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da2c7-3f42-42e5-907a-ad1cf896d825 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.186134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.186786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.187069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.187344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.188030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.190059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.296328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1007/1996] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:06:03 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:03.300523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.310598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f04d2-32d6-4df9-a924-d5e7b7c344a2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.315450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.316112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.316394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.316669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.317425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.319129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.329946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 990/1997] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:03.333856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.344123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9ed8-c592-4f74-80ae-0203417461c4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.348606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.349251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.349562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.349834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.350541 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.352112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b982-a24e-4a48-a833-be32007cb7fc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.365391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1008/1998] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:03.366488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.376118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee043ea-eb26-4de8-a900-c71998d71ce4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.383738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.385164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.385429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.385729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] PATH_INFO: `/v3/projects/2c747cecdb21423786a06777bab2c1b5/users/9cad2ba9b31a40ef835f92d622af6476/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.403037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c747cecdb21423786a06777bab2c1b5, user_id=9cad2ba9b31a40ef835f92d622af6476, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.405748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.503735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 991/1999] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:03 2022] PUT /identity/v3/projects/2c747cecdb21423786a06777bab2c1b5/users/9cad2ba9b31a40ef835f92d622af6476/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:03.517216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.517216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.517216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.549020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] MFA Rules not processed for user `9cad2ba9b31a40ef835f92d622af6476`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:03.550260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:03.613417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1009/2000] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:03.618190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.682216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c639eee-9519-4140-852a-819ce94a3189 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.686787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.687439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.687716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.687987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.688665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.690594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.813421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 992/2001] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:06:03 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:03.817660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:03.828804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11318b-28a7-41b8-a4d2-e61f4cc08360 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:03.881836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:03.882458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:03.882709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:03.882983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:03.883660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:03.886226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:03.994496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1010/2002] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:06:03 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:03.998481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.008941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268121a-f32e-482b-a4a6-19fb81f493a8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.013660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.014311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.014597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.014874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.015598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.017278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.028853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 993/2003] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:04.033169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.043664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20706da-db45-4e17-b323-88a1ce8e6159 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.048230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.049091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.049367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.049673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] PATH_INFO: `/v3/projects/e67af2090aaa440da1129b761ff7eada/users/854c3fb7a92641cbbd1ef4f56aa580e6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.064524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67af2090aaa440da1129b761ff7eada, user_id=854c3fb7a92641cbbd1ef4f56aa580e6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.067278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.166193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1011/2004] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:04 2022] PUT /identity/v3/projects/e67af2090aaa440da1129b761ff7eada/users/854c3fb7a92641cbbd1ef4f56aa580e6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:06:04.169976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.179725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf771b-8036-4514-a5e6-c0a021158e52 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.232826 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.233501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.233787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.234065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.234788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.236665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a07e7-245a-42d9-b72f-9fc26e910d7d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.246623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 994/2005] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:04.250771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.260828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df2831-651b-46ea-bf1c-d8bafd2ae8a6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.265354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.266242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.266518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.266789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] PATH_INFO: `/v3/projects/e67af2090aaa440da1129b761ff7eada/users/854c3fb7a92641cbbd1ef4f56aa580e6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.268720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67af2090aaa440da1129b761ff7eada, user_id=854c3fb7a92641cbbd1ef4f56aa580e6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.271374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.281147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1012/2006] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:04 2022] PUT /identity/v3/projects/e67af2090aaa440da1129b761ff7eada/users/854c3fb7a92641cbbd1ef4f56aa580e6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:06:04.291539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.291827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.292105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.318028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] MFA Rules not processed for user `854c3fb7a92641cbbd1ef4f56aa580e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:04.319217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:04.384531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 995/2007] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:04.395714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.397419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:04.451552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4fad-8eb8-481c-a263-d55738ce92fb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.455074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.455696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.455974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.456247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.464926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.466381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.475448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1013/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:04.682092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:04.693564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d625276-6fbd-4caa-9f88-354aac211203 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:04.695798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:04.697061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:04.697351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:04.697657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:04.754409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:04.755879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:04.764597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 996/2009] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:08.490160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:08.490160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:08.552840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839a1e-b6bd-4531-9c85-7c5117629755 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:08.557356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:08.558264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:08.558545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:08.558888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] PATH_INFO: `/v3/users/961783e6d31c442ba3488dae80355e29` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:08.560097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961783e6d31c442ba3488dae80355e29)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:08.562041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:08.767186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961783e6d31c442ba3488dae80355e29'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:08.839361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961783e6d31c442ba3488dae80355e29'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:08.851605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961783e6d31c442ba3488dae80355e29'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:08.852280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961783e6d31c442ba3488dae80355e29'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:08.858999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961783e6d31c442ba3488dae80355e29'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:08.865155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1014/2010] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:06:08 2022] DELETE /identity/v3/users/961783e6d31c442ba3488dae80355e29 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:09.109809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:09.123870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2fc77-be21-4965-b319-c7d8f9837f41 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:09.178860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:09.179719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:09.179996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:09.180268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] PATH_INFO: `/v3/projects/e9bab58ecb3843858828968064dd7878` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:09.181969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9bab58ecb3843858828968064dd7878)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:09.183864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:09.330579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9bab58ecb3843858828968064dd7878', 'request_id': 'req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.338383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9bab58ecb3843858828968064dd7878', 'request_id': 'req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.344262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9bab58ecb3843858828968064dd7878', 'request_id': 'req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.393725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] The token cache is being invalidate because project e9bab58ecb3843858828968064dd7878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:06:09.394023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.395808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.396255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 997/2011] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:06:09 2022] DELETE /identity/v3/projects/e9bab58ecb3843858828968064dd7878 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:09.400309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:09.401805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:09.415173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595aa5-56d5-41b0-b7e7-4bdda0779116 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:09.482457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:09.483433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:09.483715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:09.483995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] PATH_INFO: `/v3/users/e860ef01760d4bb3a2014f8424043397` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:09.485217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e860ef01760d4bb3a2014f8424043397)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:09.487715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:09.744905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e860ef01760d4bb3a2014f8424043397'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.804979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e860ef01760d4bb3a2014f8424043397'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.817941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e860ef01760d4bb3a2014f8424043397'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.818623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e860ef01760d4bb3a2014f8424043397'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.825325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4a698117-e1b4-49c0-b95e-9ea37e438463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e860ef01760d4bb3a2014f8424043397'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:09.831153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1015/2012] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:06:09 2022] DELETE /identity/v3/users/e860ef01760d4bb3a2014f8424043397 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:10.109494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.111351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:10.123958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e53f-3b5b-4454-ac5d-270a6cae911b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.178661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.179521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.179798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.180069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] PATH_INFO: `/v3/projects/c734cb02f2634987be53f4f20dbb123f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.181262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c734cb02f2634987be53f4f20dbb123f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.183231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.313640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c734cb02f2634987be53f4f20dbb123f', 'request_id': 'req-01de6afa-f996-4c49-8dea-ae841732af33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:10.319722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c734cb02f2634987be53f4f20dbb123f', 'request_id': 'req-01de6afa-f996-4c49-8dea-ae841732af33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:10.325751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c734cb02f2634987be53f4f20dbb123f', 'request_id': 'req-01de6afa-f996-4c49-8dea-ae841732af33'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:10.416006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] The token cache is being invalidate because project c734cb02f2634987be53f4f20dbb123f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:06:10.416292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:10.416929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-01de6afa-f996-4c49-8dea-ae841732af33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:10.418515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 998/2013] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:06:10 2022] DELETE /identity/v3/projects/c734cb02f2634987be53f4f20dbb123f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:10.423420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.423708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.429113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.442239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:10.443425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:10.501323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1016/2014] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:10.509684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.510077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.510485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.528532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:10.529739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:10.537486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 999/2015] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:10.541773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.551324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e61b-80ad-4aca-a6ee-bffb8c69b9c7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.556418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.557069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.557353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.557663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.558388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:06:10.558691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.560304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.572571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1017/2016] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:06:10.576652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.586091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81714be4-c6a9-4497-ad56-3ca75bca6116 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.590848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.591506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.591785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.592060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.592752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.594736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.663210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1000/2017] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:06:10 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:10.667371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.677164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383c0d9-a443-40d2-b6cb-e8e10ccfd3f8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.732371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.733053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.733339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.733648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.734344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.736529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.804620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1018/2018] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:06:10 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:10.809308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.819443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adc49b-b395-4dd0-9885-9dd319875736 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.824007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.824655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.824935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.825207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.825967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.827561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.837623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1001/2019] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:10.841285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.850931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49020b-3302-42a8-b4d6-358ad3d063b7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.856149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.856784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.857060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.857332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.858090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.859659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4b97-a358-4e6c-8e14-70293bafdb3e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:10.870583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1019/2020] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:10.874402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:10.883865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bf5e7-31ba-4912-8e04-23512d346175 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:10.888403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:10.889264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:10.889578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:10.889855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] PATH_INFO: `/v3/projects/0ceae555bff64305a2b02bfa3d9ce426/users/726913093f33485f9d2a1f76a7fa168a/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:10.903589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceae555bff64305a2b02bfa3d9ce426, user_id=726913093f33485f9d2a1f76a7fa168a, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:10.906256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:11.040699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1002/2021] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:10 2022] PUT /identity/v3/projects/0ceae555bff64305a2b02bfa3d9ce426/users/726913093f33485f9d2a1f76a7fa168a/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:06:11.052084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:11.052370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:11.052642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:11.078709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] MFA Rules not processed for user `726913093f33485f9d2a1f76a7fa168a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:11.079901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:11.140315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1020/2022] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:11.151623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:11.153313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:11.208246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf1ed1-a5a6-47c2-9c69-b1789f1c8b06 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:11.212318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:11.212949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:11.213226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:11.213529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:11.221460 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:11.222885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380a798-9be2-4703-9935-f9a619877c82 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:11.231859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1003/2023] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:18.771530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:18.773682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:18.842564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad4bb-fde6-4da3-bad4-3cbf67638bd2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:18.847131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:18.847994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:18.848273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:18.848543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] PATH_INFO: `/v3/users/eae082c2581440949912de5111751f4b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:18.849780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae082c2581440949912de5111751f4b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:18.851718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:19.029843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae082c2581440949912de5111751f4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.125096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae082c2581440949912de5111751f4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.137517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae082c2581440949912de5111751f4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.138360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae082c2581440949912de5111751f4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.146141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae082c2581440949912de5111751f4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.152356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1021/2024] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:06:18 2022] DELETE /identity/v3/users/eae082c2581440949912de5111751f4b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:19.156893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:19.157377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:19.157514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:19.175204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:19.176493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:19.239958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1004/2025] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:19.250874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:19.251890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:19.313645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8025-7625-4488-bb4c-2448f1c36149 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:19.317321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:19.318008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:19.318289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:19.318562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:19.327367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:19.328787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfc647-6583-4b44-86e7-1cde07c9fed5 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:19.338874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1022/2026] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:19.722555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:19.724337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:19.737627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eca54-a346-4ba2-b4a4-c1df9137cc33 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:19.743624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:19.744571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:19.744852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:19.745127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] PATH_INFO: `/v3/projects/8e090573abed4f19a00220b581606500` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:19.746468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e090573abed4f19a00220b581606500)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:19.748523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:19.902167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e090573abed4f19a00220b581606500', 'request_id': 'req-15a081f4-ed69-4521-982e-fe45c90dc29f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.909071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e090573abed4f19a00220b581606500', 'request_id': 'req-15a081f4-ed69-4521-982e-fe45c90dc29f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.915361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e090573abed4f19a00220b581606500', 'request_id': 'req-15a081f4-ed69-4521-982e-fe45c90dc29f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.999043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] The token cache is being invalidate because project 8e090573abed4f19a00220b581606500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:06:19.999244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:19.999856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-15a081f4-ed69-4521-982e-fe45c90dc29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:20.001398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1005/2027] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:06:19 2022] DELETE /identity/v3/projects/8e090573abed4f19a00220b581606500 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:20.006413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.006916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.007010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.024317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:20.025534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:20.084413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1023/2028] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:20.092875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.093261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.093575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.113993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:20.115229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:20.123234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1006/2029] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:20.127802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.137393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a979c3-a695-4b90-bb5c-88096f868f3b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.142270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.142924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.143200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.143468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.144182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:06:20.144480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.146100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.161755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1024/2030] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:06:20.167628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.177383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36165f7d-2a0c-4ebd-ae32-8410010453a9 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.184231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.184900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.185227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.185592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.186300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.188245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.252415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1007/2031] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:06:20 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:20.256715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.266661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e05a-994b-4cd8-9ac2-042b3ffde637 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.321025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.321712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.321994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.322268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.322957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.324878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.411347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1025/2032] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:06:20 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:20.416069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.426348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438a9e-3e4b-47c2-815e-908fcceb3023 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.431136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.431790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.432075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.432351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.433075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.434711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.444829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1008/2033] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:20.448643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.458585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b38a77-a2f6-432b-b76f-328035abd987 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.463752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.464400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.464685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.464965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.465730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.467319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40a90-5796-4b3d-b0ca-9e260d0638bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.478715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1026/2034] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:20.482889 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.492876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0a70a-64af-483f-bfad-21843d2f0747 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.497351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.498246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.498520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.498789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] PATH_INFO: `/v3/projects/aff0f84706184f47a8781551d5d522d0/users/d4e2c2eeb5b846c28c227969aab390e1/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.513387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff0f84706184f47a8781551d5d522d0, user_id=d4e2c2eeb5b846c28c227969aab390e1, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.516014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.599501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1009/2035] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:20 2022] PUT /identity/v3/projects/aff0f84706184f47a8781551d5d522d0/users/d4e2c2eeb5b846c28c227969aab390e1/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:20.611784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.612142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.612464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.639218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] MFA Rules not processed for user `d4e2c2eeb5b846c28c227969aab390e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:20.640517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:20.710019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1027/2036] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:06:20.720980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:20.722730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:20.780473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426bffc-70fd-49ed-a992-f0dc01daa79e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:20.784008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:20.784645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:20.784932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:20.787387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:20.793417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:20.794886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f241b-7441-48ea-b7ca-d7bd2cc1f7f3 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:20.803441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1010/2037] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:57.280692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:57.282306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:57.433603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc9b3-3d01-4fb7-95bc-a60035ce4d98 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:57.438711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:57.439580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:57.439862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:57.440137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] PATH_INFO: `/v3/users/e5638e7651574756ac4291ff814a8a9f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:57.441342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5638e7651574756ac4291ff814a8a9f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:57.443878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:57.748661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5638e7651574756ac4291ff814a8a9f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:57.814324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5638e7651574756ac4291ff814a8a9f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:57.827249 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5638e7651574756ac4291ff814a8a9f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:57.827912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5638e7651574756ac4291ff814a8a9f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:57.834643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5638e7651574756ac4291ff814a8a9f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:57.840570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1028/2038] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:06:57 2022] DELETE /identity/v3/users/e5638e7651574756ac4291ff814a8a9f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:57.846666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101e39-da10-4830-9388-438c042367c5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:57.847165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101e39-da10-4830-9388-438c042367c5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:57.847450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81101e39-da10-4830-9388-438c042367c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:57.882191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-81101e39-da10-4830-9388-438c042367c5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:57.883395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81101e39-da10-4830-9388-438c042367c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:57.938730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1011/2039] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:57.949216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:57.950775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:58.044503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491500-6b6e-4ac2-a01e-9041d336e97f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:58.048107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:58.048735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:58.049013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:58.049284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:58.059756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:58.061236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e4bd8-b1c8-4749-9e92-079a1fc8f6c3 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:58.072369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1029/2040] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:06:58.526922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81101e39-da10-4830-9388-438c042367c5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:58.528208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-81101e39-da10-4830-9388-438c042367c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:58.541292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81101e39-da10-4830-9388-438c042367c5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:58.546075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:58.546932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:58.548107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:58.548107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] PATH_INFO: `/v3/projects/9c3d59fa12714b06ac852218576515fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:58.548737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3d59fa12714b06ac852218576515fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:58.550970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:58.717895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3d59fa12714b06ac852218576515fb', 'request_id': 'req-2d610643-32d6-423f-ad68-34fdbb577220'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:58.724908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3d59fa12714b06ac852218576515fb', 'request_id': 'req-2d610643-32d6-423f-ad68-34fdbb577220'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:58.730252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3d59fa12714b06ac852218576515fb', 'request_id': 'req-2d610643-32d6-423f-ad68-34fdbb577220'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:58.819855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] The token cache is being invalidate because project 9c3d59fa12714b06ac852218576515fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:06:58.820157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:58.820769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-2d610643-32d6-423f-ad68-34fdbb577220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:06:58.822389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1012/2041] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:06:58 2022] DELETE /identity/v3/projects/9c3d59fa12714b06ac852218576515fb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:58.827211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:58.827668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:58.827757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:58.872885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:58.874004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:58.933665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1030/2042] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:58.941605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:58.942082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:58.942173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:58.961262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:58.962513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:58.970353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1013/2043] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:58.975197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:58.985192 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1174cc-4c89-4283-a8d0-f4c4cc8a2b02 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:58.990356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:58.990998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:58.991280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:58.991554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:58.992294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:06:58.992595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:58.994220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.005834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1031/2044] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:06:59.010127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.019237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18acfe-062a-42a8-ba30-02847465059b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.023809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.024514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.024861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.025197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.025987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.027946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.114975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1014/2045] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:06:59 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:59.121611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.132012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa69a-39c3-4ec1-832f-00912003a807 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.186091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.186744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.187023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.187292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.187963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.189970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.275302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1032/2046] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:06:59 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:06:59.276736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.287524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345596e5-35ff-4620-87bd-66a12c19225a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.292192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.292837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.293112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.293382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.294126 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.295723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.305840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1015/2047] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:06:59.309883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.319820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b94-8bed-4bb6-8776-e7d7bb87001c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.324403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.325039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.325316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.325619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.326353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.327932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8278-11c7-48d1-8fac-a2de1bf51cf2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.341110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1033/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:06:59.342278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.352798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e2a55-c5df-4fb6-93ec-dcb6e50e7c6d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.357459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.358330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.358610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.358885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] PATH_INFO: `/v3/projects/095c1f7ad2ef48a1a0cac96c0860cf64/users/b3c353ed36d34401ab2fb163b69ee461/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.374650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095c1f7ad2ef48a1a0cac96c0860cf64, user_id=b3c353ed36d34401ab2fb163b69ee461, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.377352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.442927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1016/2049] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:06:59 2022] PUT /identity/v3/projects/095c1f7ad2ef48a1a0cac96c0860cf64/users/b3c353ed36d34401ab2fb163b69ee461/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:06:59.454805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e680-fbba-41b9-bd27-1032bdf6a631 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.455094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e680-fbba-41b9-bd27-1032bdf6a631 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.455367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e680-fbba-41b9-bd27-1032bdf6a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.483631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ebc0e680-fbba-41b9-bd27-1032bdf6a631 None None] MFA Rules not processed for user `b3c353ed36d34401ab2fb163b69ee461`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:06:59.485124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ebc0e680-fbba-41b9-bd27-1032bdf6a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:59.549239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1034/2050] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:06:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:06:59.560007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:06:59.561977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:06:59.619249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591709-5589-474c-9402-dd525c2cb2f0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:06:59.623301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:06:59.626914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:06:59.626914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:06:59.626914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:06:59.633614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:06:59.634995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:06:59.643925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1017/2051] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:06:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:04.514705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffea7-c7cf-416e-bf22-1f52ecf4eca1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:04.515245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffea7-c7cf-416e-bf22-1f52ecf4eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:04.515603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffea7-c7cf-416e-bf22-1f52ecf4eca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:04.536011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2beffea7-c7cf-416e-bf22-1f52ecf4eca1 None None] MFA Rules not processed for user `b3c353ed36d34401ab2fb163b69ee461`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:04.537213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2beffea7-c7cf-416e-bf22-1f52ecf4eca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:04.545480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1035/2052] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:06.587824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:06.590023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:06.678136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de3d3-dea9-4958-824d-3c0a0ff6cb7f service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:06.683059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:06.683934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:06.684213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:06.684485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] PATH_INFO: `/v3/users/d4e2c2eeb5b846c28c227969aab390e1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:06.685692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e2c2eeb5b846c28c227969aab390e1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:06.687638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:06.858377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e2c2eeb5b846c28c227969aab390e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:06.922644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e2c2eeb5b846c28c227969aab390e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:06.949550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e2c2eeb5b846c28c227969aab390e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:06.950306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e2c2eeb5b846c28c227969aab390e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:06.950912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e2c2eeb5b846c28c227969aab390e1'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:06.964031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1018/2053] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:06 2022] DELETE /identity/v3/users/d4e2c2eeb5b846c28c227969aab390e1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:06.968504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:06.968989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:06.969142 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:06.987310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:06.988485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:07.049764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1036/2054] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:07.060029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:07.061514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:07.120554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75438ab7-a2c0-44d5-a549-a669d3e38869 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:07.124232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:07.124876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:07.125168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:07.125457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:07.135117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:07.136561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:07.146842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1019/2055] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:07.649228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:07.651407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:07.665775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd957b1-e19d-4225-b164-413d9e1d22e3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:07.683346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:07.684367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:07.684649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:07.685827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] PATH_INFO: `/v3/projects/aff0f84706184f47a8781551d5d522d0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:07.687075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff0f84706184f47a8781551d5d522d0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:07.688989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:07.816135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff0f84706184f47a8781551d5d522d0', 'request_id': 'req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:07.833379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff0f84706184f47a8781551d5d522d0', 'request_id': 'req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:07.840723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff0f84706184f47a8781551d5d522d0', 'request_id': 'req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:07.902055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:07.903852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:07.923945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20880-83d5-46aa-b80c-a2c810e88797 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:07.994893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:07.996308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:07.996759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:07.997038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] PATH_INFO: `/v3/users/726913093f33485f9d2a1f76a7fa168a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:07.998367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726913093f33485f9d2a1f76a7fa168a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:08.000365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:08.037788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] The token cache is being invalidate because project aff0f84706184f47a8781551d5d522d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:08.038765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.039702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ae8ae98-8f89-4d92-b0cb-fa884c7a799e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.042087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1037/2056] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:07 2022] DELETE /identity/v3/projects/aff0f84706184f47a8781551d5d522d0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:08.262029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726913093f33485f9d2a1f76a7fa168a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.329242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726913093f33485f9d2a1f76a7fa168a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.359167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726913093f33485f9d2a1f76a7fa168a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.359167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726913093f33485f9d2a1f76a7fa168a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.359167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726913093f33485f9d2a1f76a7fa168a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:08.359167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1020/2057] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:07 2022] DELETE /identity/v3/users/726913093f33485f9d2a1f76a7fa168a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:08.361412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90034-faec-4c81-a795-a72480865af4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:08.361809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90034-faec-4c81-a795-a72480865af4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:08.362164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90034-faec-4c81-a795-a72480865af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:08.383399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-22d90034-faec-4c81-a795-a72480865af4 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:08.384987 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-22d90034-faec-4c81-a795-a72480865af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:08.458855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1038/2058] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:08.469083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:08.470849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:08.532020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3624f52-beaf-46df-a400-6e07e0d50c81 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:08.536386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:08.537161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:08.537696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:08.538022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:08.548742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:08.550258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277648-0f60-457c-8577-bd6055905a56 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:08.561624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1021/2059] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:09.224713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90034-faec-4c81-a795-a72480865af4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:09.226391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-22d90034-faec-4c81-a795-a72480865af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:09.240492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90034-faec-4c81-a795-a72480865af4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:09.250910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:09.258970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:09.259911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:09.260533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] PATH_INFO: `/v3/projects/0ceae555bff64305a2b02bfa3d9ce426` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:09.262247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ceae555bff64305a2b02bfa3d9ce426)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:09.265073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:09.419863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ceae555bff64305a2b02bfa3d9ce426', 'request_id': 'req-8ae42bfc-4412-4025-a377-93062ddb64be'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:09.434663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ceae555bff64305a2b02bfa3d9ce426', 'request_id': 'req-8ae42bfc-4412-4025-a377-93062ddb64be'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:09.443621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ceae555bff64305a2b02bfa3d9ce426', 'request_id': 'req-8ae42bfc-4412-4025-a377-93062ddb64be'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:09.605108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] The token cache is being invalidate because project 0ceae555bff64305a2b02bfa3d9ce426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:09.664217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:09.664217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ae42bfc-4412-4025-a377-93062ddb64be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:09.664217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1039/2060] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:09 2022] DELETE /identity/v3/projects/0ceae555bff64305a2b02bfa3d9ce426 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:09.666128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:09.666632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:09.666782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:09.692132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:09.693687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:09.760675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1022/2061] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:09.768472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:09.768762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:09.769046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:09.787134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:09.788313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:09.796573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1040/2062] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:09.800482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:09.810941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7956d1-89b9-459a-bffc-2fcf0ce372da None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:09.817489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:09.818285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:09.818635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:09.818980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:09.819781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:09.820185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:09.821893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:09.835271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1023/2063] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:09.849721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:09.860274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12841b3-7158-47b6-90dc-91e6e9745ab0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:09.867522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:09.868187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:09.868464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:09.868732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:09.869426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:09.871355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:09.986841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1041/2064] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:09 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:07:09.991362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:10.011134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893ef69-1d59-4f86-861d-acd8a6780bde admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:10.110492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:10.111561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.111859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.112383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.113190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:10.115381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:10.238881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1024/2065] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:09 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:10.242890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:10.253735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3fce-f5fe-4f5f-8ea2-4320b4c150dd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:10.258874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:10.259594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.259956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.260259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.261012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:10.262630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:10.274174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1042/2066] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:10.278410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:10.288650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dbc9b-e1d9-42b8-b925-f32b837b45bd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:10.298426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:10.298426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.298426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.298426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.298763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:10.298763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49283b-e797-447d-8d8c-3ec8db2caae8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:10.317898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1025/2067] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:10.338737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:10.338737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08c467-11cd-43dd-b755-93a671a7d71f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:10.355253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:10.356301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.356586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.356858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] PATH_INFO: `/v3/projects/41ad3c31a86c405fb1969d26a79880ef/users/378ab45c8f4c42dc9d2b64866a55d617/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.378704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ad3c31a86c405fb1969d26a79880ef, user_id=378ab45c8f4c42dc9d2b64866a55d617, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:10.382675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:10.459820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1043/2068] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:10 2022] PUT /identity/v3/projects/41ad3c31a86c405fb1969d26a79880ef/users/378ab45c8f4c42dc9d2b64866a55d617/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:10.471885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.472181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.472451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.501034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] MFA Rules not processed for user `378ab45c8f4c42dc9d2b64866a55d617`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:10.502584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:10.576539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1026/2069] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:10.586990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:10.588796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:10.679127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fb76-b54b-4db1-98ee-b36f99f5c8b1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:10.683056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:10.683637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:10.683923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:10.684206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:10.699808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:10.701473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffd4c-e587-43e8-839a-d9ba5b8957a9 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:10.712152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1044/2070] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:14.487056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:14.487534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:14.576713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068a9-5582-443c-9d59-bcdc1481ba8d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:14.577405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068a9-5582-443c-9d59-bcdc1481ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:14.577405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5068a9-5582-443c-9d59-bcdc1481ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:14.595247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6b5068a9-5582-443c-9d59-bcdc1481ba8d None None] MFA Rules not processed for user `ceb7b426bbef4637890ee6e203aee9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:14.596458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6b5068a9-5582-443c-9d59-bcdc1481ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:14.600192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f6775-4db4-401c-82da-228f1e78d0b5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:14.606286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:14.606931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:14.607213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:14.607481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:14.609558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:14.621355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:14.623017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:14.633981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1027/2071] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:14.665640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1045/2072] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:27.193759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:27.317232 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e701-5f49-48ad-b6ca-7a78a85fc792 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:27.322721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:27.323931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:27.324339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:27.324689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] PATH_INFO: `/v3/users/378ab45c8f4c42dc9d2b64866a55d617` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:27.326357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=378ab45c8f4c42dc9d2b64866a55d617)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:27.328636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:27.558368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378ab45c8f4c42dc9d2b64866a55d617'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:27.647354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378ab45c8f4c42dc9d2b64866a55d617'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:27.664710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378ab45c8f4c42dc9d2b64866a55d617'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:27.665519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378ab45c8f4c42dc9d2b64866a55d617'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:27.666504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378ab45c8f4c42dc9d2b64866a55d617'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:27.681352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1028/2073] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:27 2022] DELETE /identity/v3/users/378ab45c8f4c42dc9d2b64866a55d617 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:27.686099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:27.686598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:27.686682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:27.711864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:27.713605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:27.783465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1046/2074] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:27.797429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:27.801419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:27.870286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bffabe-9f9c-4e65-a8b6-e783f631c47b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:27.874091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:27.881319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:27.881319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:27.881319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:27.885124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:27.886597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e88b7-6d5b-45ec-a370-79c4799cf4ee service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:27.896437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1029/2075] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:28.324699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:28.326254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:28.342711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a622-a8d5-4590-9c76-b18eef0e01ad None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:28.345734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:28.351535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:28.351535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:28.351535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] PATH_INFO: `/v3/projects/41ad3c31a86c405fb1969d26a79880ef` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:28.351535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ad3c31a86c405fb1969d26a79880ef)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:28.353426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:28.509641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ad3c31a86c405fb1969d26a79880ef', 'request_id': 'req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:28.515864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ad3c31a86c405fb1969d26a79880ef', 'request_id': 'req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:28.521824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ad3c31a86c405fb1969d26a79880ef', 'request_id': 'req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:28.636232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] The token cache is being invalidate because project 41ad3c31a86c405fb1969d26a79880ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:28.636232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:28.636232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a397cc66-cdc6-4b6a-9cee-9c008a3bd764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:28.639934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1047/2076] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:28 2022] DELETE /identity/v3/projects/41ad3c31a86c405fb1969d26a79880ef => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:28.650894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:28.651494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:28.651494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:28.672462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:28.673963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:28.735723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1030/2077] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:28.743412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:28.743911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:28.744001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:28.769048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:28.774086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:28.787114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1048/2078] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:28.788350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:28.799275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870bb9a-4c8d-4630-9b6c-5ae843781882 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:28.804622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:28.805339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:28.805718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:28.806057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:28.806853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:28.807226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:28.809083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:28.836926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1031/2079] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:28.838664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:28.848785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6455492-5e60-476c-9604-c25d507ccd00 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:28.853908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:28.854631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:28.854986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:28.855332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:28.856054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:28.858039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:28.981108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1049/2080] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:28 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:07:28.985409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.008416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8a2c-68d1-4fa0-9dd4-44b350ea6f8e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.015546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.017223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:29.088028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.088841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.089282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.089683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.090439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.093941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.115288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5ac75-8a23-4bdd-ad41-5f065bcb1ef7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.115288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.115288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.115288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.115675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] PATH_INFO: `/v3/users/9cad2ba9b31a40ef835f92d622af6476` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.115675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cad2ba9b31a40ef835f92d622af6476)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.115675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.264729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1032/2081] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:28 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:07:29.269632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.279718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf632ee-3f8a-4070-8804-95c9e40b14ce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.284999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.285684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.285968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.286244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.286968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.288607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.301854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1033/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:29.302903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.314114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ccad-0fae-4649-80e7-330611cb08c3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.318997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.319735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.320091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.320315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.321035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.322706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.334263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1034/2083] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:29.338661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.348877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bada-b22e-4b1c-822b-f93457f1468b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.353661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.354552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.354828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.355103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] PATH_INFO: `/v3/projects/0123f472c5eb415ab60503caccdae8c4/users/b5f779f5a0d044bb81b80a475ae11f5a/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.371218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0123f472c5eb415ab60503caccdae8c4, user_id=b5f779f5a0d044bb81b80a475ae11f5a, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.373996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b3b9-6e2e-4ca4-a453-cc065b3e9dcc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.522620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cad2ba9b31a40ef835f92d622af6476'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:29.564472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1035/2084] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:29 2022] PUT /identity/v3/projects/0123f472c5eb415ab60503caccdae8c4/users/b5f779f5a0d044bb81b80a475ae11f5a/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:29.568155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.568448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.572242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.604190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] MFA Rules not processed for user `b5f779f5a0d044bb81b80a475ae11f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:29.605670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:29.623839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cad2ba9b31a40ef835f92d622af6476'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:29.653621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cad2ba9b31a40ef835f92d622af6476'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:29.654742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cad2ba9b31a40ef835f92d622af6476'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:29.663945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d0c03a62-5069-412f-8097-48a874385e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cad2ba9b31a40ef835f92d622af6476'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:29.670832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1050/2085] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:29 2022] DELETE /identity/v3/users/9cad2ba9b31a40ef835f92d622af6476 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:29.675074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.675455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.675786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.677774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1036/2086] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:29.682723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.685182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:29.694239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:29.695468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:29.759244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1051/2087] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:29.771692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.773066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:29.774103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f32fe3-75fb-43cc-b2b5-b62e04dd17e1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.779291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.780056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.780441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.780781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.781596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.784074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.831635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c05-ddfa-48c9-8f50-316c39ea3659 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.835412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.836137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.836490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.836834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.846586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.848048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:29.858843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1052/2088] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:29.912933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1037/2089] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:29 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:29.914740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:29.928194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921488-86d0-4c1b-85f5-73ea9bcc85c5 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:29.989617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:29.990297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:29.990582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:29.990858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:29.991547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:29.993515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.097200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1053/2090] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:29 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:30.100531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.125280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452b54-e255-4ea8-a08a-e928eb36736a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.142073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.143072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.143536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.144020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.144945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.146972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.158675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1038/2091] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:30.163466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.176325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587f13-bf95-4e95-9a22-cb80c4995574 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.182173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.183824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.184312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.184601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] PATH_INFO: `/v3/projects/136699ab2f1d4873b41041355408674a/users/b255510df5cc4f65a4f4ecb6c7fab122/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.206343 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136699ab2f1d4873b41041355408674a, user_id=b255510df5cc4f65a4f4ecb6c7fab122, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.216736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.281980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1054/2092] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:30 2022] PUT /identity/v3/projects/136699ab2f1d4873b41041355408674a/users/b255510df5cc4f65a4f4ecb6c7fab122/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:30.286667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.297403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc0b95-11a4-47d1-ab8f-cbbd6faf90eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.328701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.330514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:30.366134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.367079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.367312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.367794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.368958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.371207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.389475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1039/2093] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:30.391957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.402102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7590-d920-4bbf-8e72-a8011e217c8e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.407574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.408461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.409617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.409861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] PATH_INFO: `/v3/projects/136699ab2f1d4873b41041355408674a/users/b255510df5cc4f65a4f4ecb6c7fab122/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.412011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136699ab2f1d4873b41041355408674a, user_id=b255510df5cc4f65a4f4ecb6c7fab122, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.414758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f8021-1b4d-42ea-9527-8216d60bb6c4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.422472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106ba-02a9-4578-b486-5d13a98655a5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.426744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1040/2094] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:30 2022] PUT /identity/v3/projects/136699ab2f1d4873b41041355408674a/users/b255510df5cc4f65a4f4ecb6c7fab122/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:30.438197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.438542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.438758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.472435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] MFA Rules not processed for user `b255510df5cc4f65a4f4ecb6c7fab122`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:30.473678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:30.485139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.486125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.486650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.486805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] PATH_INFO: `/v3/projects/2c747cecdb21423786a06777bab2c1b5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.488644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c747cecdb21423786a06777bab2c1b5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.490654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.542265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1041/2095] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:30.553961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.555341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:30.583535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c747cecdb21423786a06777bab2c1b5', 'request_id': 'req-3575fd2f-1761-43af-bb6e-a98f456528f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:30.590700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c747cecdb21423786a06777bab2c1b5', 'request_id': 'req-3575fd2f-1761-43af-bb6e-a98f456528f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:30.597033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c747cecdb21423786a06777bab2c1b5', 'request_id': 'req-3575fd2f-1761-43af-bb6e-a98f456528f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:30.618495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209986-db60-46fa-9a28-b72cd179f621 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.667039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.667689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.667975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.668286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.693705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] The token cache is being invalidate because project 2c747cecdb21423786a06777bab2c1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:30.694534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:30.695806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:30.701146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1055/2096] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:30 2022] DELETE /identity/v3/projects/2c747cecdb21423786a06777bab2c1b5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:30.702288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:30.704130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:30.733800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.735900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:30.748734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1042/2097] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:30.806964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575fd2f-1761-43af-bb6e-a98f456528f1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:30.813114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:30.814051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:30.814337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:30.814669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] PATH_INFO: `/v3/users/854c3fb7a92641cbbd1ef4f56aa580e6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:30.817305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] RBAC: Authorizing `identity:delete_user(user_id=854c3fb7a92641cbbd1ef4f56aa580e6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:30.820086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:31.071711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854c3fb7a92641cbbd1ef4f56aa580e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.149723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854c3fb7a92641cbbd1ef4f56aa580e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.167694 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854c3fb7a92641cbbd1ef4f56aa580e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.168362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854c3fb7a92641cbbd1ef4f56aa580e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.175726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a996bfc4-a986-4787-8730-27f94c88957b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854c3fb7a92641cbbd1ef4f56aa580e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.182000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1056/2098] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:30 2022] DELETE /identity/v3/users/854c3fb7a92641cbbd1ef4f56aa580e6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:31.678178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:31.701565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb83d-0b27-4e55-ab78-682c5775d151 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:31.765528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:31.766437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:31.766716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:31.767161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] PATH_INFO: `/v3/projects/e67af2090aaa440da1129b761ff7eada` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:31.768478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67af2090aaa440da1129b761ff7eada)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:31.770706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:31.904360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67af2090aaa440da1129b761ff7eada', 'request_id': 'req-59cc6eff-6209-4af2-bfb9-02d3d759710e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.911769 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67af2090aaa440da1129b761ff7eada', 'request_id': 'req-59cc6eff-6209-4af2-bfb9-02d3d759710e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:31.917691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67af2090aaa440da1129b761ff7eada', 'request_id': 'req-59cc6eff-6209-4af2-bfb9-02d3d759710e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:32.012209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] The token cache is being invalidate because project e67af2090aaa440da1129b761ff7eada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:32.012498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:32.013120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-59cc6eff-6209-4af2-bfb9-02d3d759710e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:32.014743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1043/2099] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:31 2022] DELETE /identity/v3/projects/e67af2090aaa440da1129b761ff7eada => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:32.019839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.021684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.023034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.052607 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:32.053931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:32.112931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1057/2100] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:32.121139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085db-072f-4735-9279-9148fc98b19e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.121426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085db-072f-4735-9279-9148fc98b19e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.121750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085db-072f-4735-9279-9148fc98b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.139842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-961085db-072f-4735-9279-9148fc98b19e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:32.141033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-961085db-072f-4735-9279-9148fc98b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:32.149365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1044/2101] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:32.153665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.163790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a7a7-1e70-43dd-b4b1-e3f63c682d40 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.168232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.168878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.169159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.169453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.170178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:32.170479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.172065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.183334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1058/2102] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:07:32.187563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961085db-072f-4735-9279-9148fc98b19e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.196549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961085db-072f-4735-9279-9148fc98b19e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.201169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.201831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.202117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.202393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.203084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.204999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.303035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1045/2103] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:32.304554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.314921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c817-ff50-41d6-b65e-8aad77d3b049 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.370405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.371066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.371350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.371627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.372307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.374258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.467640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1059/2104] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:32.468741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.480258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fda89-3ce1-4f8b-8eff-df3fd8bb5441 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.485354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.486114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.486395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.486765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.487538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.489187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.500697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1046/2105] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:32.505277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.515766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77298f-5d4e-4ae1-9ad2-bb2695613883 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.521535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.522019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.522374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.522719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.523511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.525179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11385f94-a6f7-409f-b9cb-f629d542e40f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.545902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1060/2106] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:32.550097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.560825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e681d-a5c4-4d81-aae9-4ffc4c108e69 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.566338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.567527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.567907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.568285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] PATH_INFO: `/v3/projects/c30dc931d656404daae9697bc27200f1/users/6905ff7bbd0046139da764fe7ea6aeac/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.587933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30dc931d656404daae9697bc27200f1, user_id=6905ff7bbd0046139da764fe7ea6aeac, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.590993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.683815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1047/2107] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:32 2022] PUT /identity/v3/projects/c30dc931d656404daae9697bc27200f1/users/6905ff7bbd0046139da764fe7ea6aeac/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:32.696224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.696726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.696956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.745197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] MFA Rules not processed for user `6905ff7bbd0046139da764fe7ea6aeac`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:32.746845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:32.812404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1061/2108] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:32.817001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.878794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaa2a2-00fa-452b-adf6-ffa580533a42 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:32.883469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:32.884152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:32.885084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:32.885372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:32.886114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:32.888062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:32.972094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1048/2109] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:32.973196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:32.984122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cdd9c-17b0-4efc-abed-06fb1368d196 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.038484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.039280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.039458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.039599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.040323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.042278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.147784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1062/2110] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:32 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:33.149113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:33.160211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326974-c4ee-4ba9-aff2-f1d5ecc6398b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.164905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.165668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.166032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.166479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.167272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.169100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.183752 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1049/2111] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:33.184964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:33.195230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96921db-51d5-4562-8813-d13c0994794d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.200416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.201292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.201618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.201888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] PATH_INFO: `/v3/projects/572858cd961946538161aed4685d6aaf/users/3dd2064ed23e4055a72520b3a292611d/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.218399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572858cd961946538161aed4685d6aaf, user_id=3dd2064ed23e4055a72520b3a292611d, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.221675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.291151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1063/2112] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:33 2022] PUT /identity/v3/projects/572858cd961946538161aed4685d6aaf/users/3dd2064ed23e4055a72520b3a292611d/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:33.292306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:33.302659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4030984-debd-4b6c-9adf-733e19098df5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.370325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.371151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.371563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.371947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.372884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.374658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f879b3b-2bcb-4e4c-bdcf-e12fdd73e28e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.389549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1050/2113] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:33.393553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:33.404960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3ce73-801b-440c-9340-581666f08d86 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.410134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.411053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.411377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.411658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] PATH_INFO: `/v3/projects/572858cd961946538161aed4685d6aaf/users/3dd2064ed23e4055a72520b3a292611d/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.413852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572858cd961946538161aed4685d6aaf, user_id=3dd2064ed23e4055a72520b3a292611d, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.416498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.428172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1064/2114] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:33 2022] PUT /identity/v3/projects/572858cd961946538161aed4685d6aaf/users/3dd2064ed23e4055a72520b3a292611d/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:33.439589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.441241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.441829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.472674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] MFA Rules not processed for user `3dd2064ed23e4055a72520b3a292611d`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:33.474013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:33.550498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1051/2115] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:33.562339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:33.564232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:33.638949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5786-57f5-4677-ba1b-4d8ccf243634 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:33.649639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:33.650576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:33.651994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:33.652440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:33.666161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:33.670190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:33.694248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1065/2116] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:34.887089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:34.951402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f688fd-a39a-4c15-be20-e2db48a551ee None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:34.960091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:34.960091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:34.960091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:34.960091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] PATH_INFO: `/v3/users/6905ff7bbd0046139da764fe7ea6aeac` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:34.960437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6905ff7bbd0046139da764fe7ea6aeac)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:34.962227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:35.246928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:35.252978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.282669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6905ff7bbd0046139da764fe7ea6aeac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.287675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c86a3-a84e-4cca-b75d-935da9c3b300 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:35.296584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:35.297778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.298157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.298533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] PATH_INFO: `/v3/users/b5f779f5a0d044bb81b80a475ae11f5a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.300922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f779f5a0d044bb81b80a475ae11f5a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:35.303636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:35.355547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6905ff7bbd0046139da764fe7ea6aeac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.372500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6905ff7bbd0046139da764fe7ea6aeac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.373369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6905ff7bbd0046139da764fe7ea6aeac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.374290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3292fe8e-c315-4387-9215-0e4796adefaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6905ff7bbd0046139da764fe7ea6aeac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.395388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1052/2117] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:34 2022] DELETE /identity/v3/users/6905ff7bbd0046139da764fe7ea6aeac => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:35.401478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c540d1-5a9b-4449-b7fa-766096a002ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.401478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c540d1-5a9b-4449-b7fa-766096a002ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.401478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c540d1-5a9b-4449-b7fa-766096a002ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.429368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e7c540d1-5a9b-4449-b7fa-766096a002ea None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:35.431081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e7c540d1-5a9b-4449-b7fa-766096a002ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.499784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f779f5a0d044bb81b80a475ae11f5a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.519720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1053/2118] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:35.521005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951364-a4bd-452e-ae88-55b1c0d85f45 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.521353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951364-a4bd-452e-ae88-55b1c0d85f45 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.521735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951364-a4bd-452e-ae88-55b1c0d85f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.585483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e3951364-a4bd-452e-ae88-55b1c0d85f45 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:35.587249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e3951364-a4bd-452e-ae88-55b1c0d85f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.589077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f779f5a0d044bb81b80a475ae11f5a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.602360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f779f5a0d044bb81b80a475ae11f5a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.603132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f779f5a0d044bb81b80a475ae11f5a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.610205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f779f5a0d044bb81b80a475ae11f5a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:35.616485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1066/2119] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:35 2022] DELETE /identity/v3/users/b5f779f5a0d044bb81b80a475ae11f5a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:35.620178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:35.622041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.661723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1054/2120] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:35.662893 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.663182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.663836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.683801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:35.685043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.716635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafbc21-9e7a-4c24-ae72-4350d9588b93 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:35.721760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:35.722473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.722759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.723026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.724901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.750554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1055/2121] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:35.761283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:35.762849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.804790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:35.806272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:35.826711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1067/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:35.829798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:35.833175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:35.847453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994c56a-4704-44eb-85e2-5f8e3247f376 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:35.853576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:35.854972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.855482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.855957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.870496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:35.870802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bae0b-ba52-4c3f-a8ef-9f947efaa620 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:35.872825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:35.876472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:35.877801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:35.878091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:35.878365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:35.888004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1068/2123] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:35.954794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:35.956535 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:35.966488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1056/2124] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:07:36.392561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:36.395016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:36.423404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b1add-3db1-4737-9e9e-d8bf34dd157b service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:36.431673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:36.432767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:36.433188 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:36.433731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] PATH_INFO: `/v3/projects/0123f472c5eb415ab60503caccdae8c4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:36.435075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0123f472c5eb415ab60503caccdae8c4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:36.439361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:36.561051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0123f472c5eb415ab60503caccdae8c4', 'request_id': 'req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.568415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0123f472c5eb415ab60503caccdae8c4', 'request_id': 'req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.577370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0123f472c5eb415ab60503caccdae8c4', 'request_id': 'req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.605681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:36.607647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:36.639615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6604f3-2f3c-411c-968e-964d446e22e5 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:36.658950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] The token cache is being invalidate because project 0123f472c5eb415ab60503caccdae8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:36.658950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.658950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.658950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1069/2125] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:36 2022] DELETE /identity/v3/projects/0123f472c5eb415ab60503caccdae8c4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:36.661815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:36.663247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:36.716956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:36.717882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:36.718169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:36.718440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] PATH_INFO: `/v3/projects/c30dc931d656404daae9697bc27200f1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:36.719655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30dc931d656404daae9697bc27200f1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:36.722412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:36.754570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738abb-1c4e-47ce-bbde-79a0e7b8fe76 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:36.760562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:36.761609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:36.761897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:36.762176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] PATH_INFO: `/v3/users/b255510df5cc4f65a4f4ecb6c7fab122` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:36.763533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b255510df5cc4f65a4f4ecb6c7fab122)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:36.766033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:36.830790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30dc931d656404daae9697bc27200f1', 'request_id': 'req-902d229e-7a96-4908-a220-357555b42cac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.837218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30dc931d656404daae9697bc27200f1', 'request_id': 'req-902d229e-7a96-4908-a220-357555b42cac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.842924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30dc931d656404daae9697bc27200f1', 'request_id': 'req-902d229e-7a96-4908-a220-357555b42cac'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.937676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] The token cache is being invalidate because project c30dc931d656404daae9697bc27200f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:36.937956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.938570 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:36.940831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1057/2126] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:36 2022] DELETE /identity/v3/projects/c30dc931d656404daae9697bc27200f1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:36.949004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:36.950945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:36.964129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b255510df5cc4f65a4f4ecb6c7fab122'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.024271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b255510df5cc4f65a4f4ecb6c7fab122'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.041599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b255510df5cc4f65a4f4ecb6c7fab122'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.042530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b255510df5cc4f65a4f4ecb6c7fab122'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.051411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c215e911-db49-4d5e-8202-6ac1a099ad8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b255510df5cc4f65a4f4ecb6c7fab122'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.056352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d229e-7a96-4908-a220-357555b42cac admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:37.057815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1070/2127] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:36 2022] DELETE /identity/v3/users/b255510df5cc4f65a4f4ecb6c7fab122 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:37.062274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:37.062666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:37.063044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:37.082410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:37.083938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:37.132393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:37.133302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:37.133777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:37.134336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] PATH_INFO: `/v3/users/3dd2064ed23e4055a72520b3a292611d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:37.136183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd2064ed23e4055a72520b3a292611d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:37.138301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:37.169605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1071/2128] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:07:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:37.173644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:37.175760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:37.246026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd47f-b5d7-4925-ad30-f9042f226c9b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:37.264555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:37.265229 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:37.265563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:37.265845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:37.277455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:37.279104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:37.289909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1072/2129] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 06:07:37.314799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd2064ed23e4055a72520b3a292611d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.367222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd2064ed23e4055a72520b3a292611d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.381105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd2064ed23e4055a72520b3a292611d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.383663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd2064ed23e4055a72520b3a292611d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.384304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0e814158-8437-40f6-a11c-ac9cc00f0d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd2064ed23e4055a72520b3a292611d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.397419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1058/2130] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:36 2022] DELETE /identity/v3/users/3dd2064ed23e4055a72520b3a292611d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:37.483182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:37.484466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:37.498805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be6cd-0680-43ac-936a-4ef0e0462736 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:37.605225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:37.606123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:37.606499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:37.606777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] PATH_INFO: `/v3/projects/136699ab2f1d4873b41041355408674a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:37.608703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136699ab2f1d4873b41041355408674a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:37.610664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:37.781533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136699ab2f1d4873b41041355408674a', 'request_id': 'req-c17b8b61-f22b-4559-a341-606af3ce3679'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.789565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136699ab2f1d4873b41041355408674a', 'request_id': 'req-c17b8b61-f22b-4559-a341-606af3ce3679'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.797086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136699ab2f1d4873b41041355408674a', 'request_id': 'req-c17b8b61-f22b-4559-a341-606af3ce3679'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.927130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] The token cache is being invalidate because project 136699ab2f1d4873b41041355408674a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:37.927434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.928098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:37.929707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1073/2131] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:37 2022] DELETE /identity/v3/projects/136699ab2f1d4873b41041355408674a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:37.934845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325953e5-19f6-4155-9f0b-a89425b3644a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:37.935134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325953e5-19f6-4155-9f0b-a89425b3644a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:37.935440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325953e5-19f6-4155-9f0b-a89425b3644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:37.953904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:37.958565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:37.961712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-325953e5-19f6-4155-9f0b-a89425b3644a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:37.962884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-325953e5-19f6-4155-9f0b-a89425b3644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.034700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1059/2132] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:38.043585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbf12-03db-423a-82ad-992a4fcbebd7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.044542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbf12-03db-423a-82ad-992a4fcbebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.045113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbf12-03db-423a-82ad-992a4fcbebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.046741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b8b61-f22b-4559-a341-606af3ce3679 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.052854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.053746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.054043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.054303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] PATH_INFO: `/v3/projects/572858cd961946538161aed4685d6aaf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.055498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572858cd961946538161aed4685d6aaf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.057420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.068940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-807cbf12-03db-423a-82ad-992a4fcbebd7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:38.071121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-807cbf12-03db-423a-82ad-992a4fcbebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.084576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1060/2133] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:38.084576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.084576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.084576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.104257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:38.105481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.159979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1061/2134] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:38.162386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.175314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070cf4a-58a0-48a0-8f23-8b6f13db5769 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.180521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.181335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.181811 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.182187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.183035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:38.183345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.185041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.191581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572858cd961946538161aed4685d6aaf', 'request_id': 'req-05270e77-6323-4148-868c-40dc8642cec7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:38.198095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572858cd961946538161aed4685d6aaf', 'request_id': 'req-05270e77-6323-4148-868c-40dc8642cec7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:38.200757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1062/2135] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:38.201713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.203469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.208262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572858cd961946538161aed4685d6aaf', 'request_id': 'req-05270e77-6323-4148-868c-40dc8642cec7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:38.271549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0771af-6380-4df5-b47d-9ef4707db319 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.274956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] The token cache is being invalidate because project 572858cd961946538161aed4685d6aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:38.275465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:38.276168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:38.278027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1074/2136] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:37 2022] DELETE /identity/v3/projects/572858cd961946538161aed4685d6aaf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:38.278736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.284736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.337206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.338057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.338431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.338808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.340742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.354001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270e77-6323-4148-868c-40dc8642cec7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.359018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.359680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.359967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.360244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.361058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.363050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.403956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.405720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5942dc-64b4-48b4-9ed0-94cba9e5b9f0 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.415287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1063/2137] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:07:38.417073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38640-487f-4704-bf9a-d10c7a1c42f6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.417293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38640-487f-4704-bf9a-d10c7a1c42f6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.417647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38640-487f-4704-bf9a-d10c7a1c42f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.436059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-72f38640-487f-4704-bf9a-d10c7a1c42f6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:38.437454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-72f38640-487f-4704-bf9a-d10c7a1c42f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.445997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1064/2138] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:38.454023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.454306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.454698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.464412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1075/2139] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:38.465602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.473886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:38.475078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:38.538174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1065/2140] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:38.541900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.542201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3900-63b0-4771-88e8-fdad35182e1b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.547566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.548441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.548818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.549156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.549934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.551786 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a466c3-0331-41c1-ab8d-1241701e74c8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.552171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.561399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.561567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.561902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.562111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.563380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:38.563688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.566730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.597669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1066/2141] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:07:38.600940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.612062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a98a-6f8d-431d-a140-34edf3813127 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.616828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.617568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.617917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.618234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.618957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.621006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.831225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1076/2142] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:38.835555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.847359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829532c-548a-458a-9294-1e13ca7e78d5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.861477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.864121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.864121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.864121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.864121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.866571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1067/2143] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:38.870635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.871672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.894042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1077/2144] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:38.898473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:38.911196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b766d-e88f-4ef5-8b89-f19aa7374e14 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.949901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d008717-a1e9-4fd3-bb3b-cbc26feccf30 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:38.955603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.956457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.956957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.957400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.958366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.960567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.978105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:38.981349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:38.981349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:38.981349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:38.981349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:38.981946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:38.993308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1078/2145] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:38.997854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.016160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01cf5-c88a-4802-ba06-eef73f4d01a8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.024620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.026332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.026943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.027537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] PATH_INFO: `/v3/projects/f066b5271f024324be4197e743866d04/users/2abe0ff43a18414e9bacb2be3e7f4117/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.056148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f066b5271f024324be4197e743866d04, user_id=2abe0ff43a18414e9bacb2be3e7f4117, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.059755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1cdb-beeb-45fd-a512-202379fc70b0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.065267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1068/2146] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:38 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:39.070677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.083920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5df6c-ec63-48b9-998a-1ae1807a30c8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.089404 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.090557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.091007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.091501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.092403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.094804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.107028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1069/2147] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:39.111869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.135630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11138-3b6f-462b-8172-6c30b693a644 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.145887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.146971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.147448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.150003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.151161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.153066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.164023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1079/2148] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:38 2022] PUT /identity/v3/projects/f066b5271f024324be4197e743866d04/users/2abe0ff43a18414e9bacb2be3e7f4117/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:39.174672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c180b-9f6f-413a-aeb7-84169b060e1c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.174825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c180b-9f6f-413a-aeb7-84169b060e1c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.175044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c180b-9f6f-413a-aeb7-84169b060e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.193594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1070/2149] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:39.198333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.212040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a78c180b-9f6f-413a-aeb7-84169b060e1c None None] MFA Rules not processed for user `2abe0ff43a18414e9bacb2be3e7f4117`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:39.212040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a78c180b-9f6f-413a-aeb7-84169b060e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:39.212440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042c6d-4cc7-4e71-8e85-e7072defa859 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.282772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.283795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.284077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.284828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] PATH_INFO: `/v3/projects/e34b7f4f913c44dabb3b6afcacf825d4/users/996a09358d2b4870ace60d25062508a1/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.322624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34b7f4f913c44dabb3b6afcacf825d4, user_id=996a09358d2b4870ace60d25062508a1, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.326345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.337786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1080/2150] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:39.339077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6946b4-b33c-487b-8325-b4a2f622b397 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.339599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6946b4-b33c-487b-8325-b4a2f622b397 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.340039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6946b4-b33c-487b-8325-b4a2f622b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.362851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4c6946b4-b33c-487b-8325-b4a2f622b397 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:39.364387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4c6946b4-b33c-487b-8325-b4a2f622b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:39.414913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1071/2151] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:39 2022] PUT /identity/v3/projects/e34b7f4f913c44dabb3b6afcacf825d4/users/996a09358d2b4870ace60d25062508a1/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:39.414913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.440185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1081/2152] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:39.443374 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.443887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.444298 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.480476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] MFA Rules not processed for user `996a09358d2b4870ace60d25062508a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:39.482013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:39.491197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9e1c0-dc11-4e3a-a30b-4c172899ce74 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.496771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.498090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.498683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.499209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.500113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.502967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.557737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1082/2153] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:39.562376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.565143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:39.594307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1072/2154] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:39.594307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.664829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983fdf-7925-4b36-add5-079673fcdd50 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.695075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caf835-795c-4b59-ab6c-2454cc08d482 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.700186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.700843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.701130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.701405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.702176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.704100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.747101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.747780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.748178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.748389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.769924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1073/2155] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:39.769924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.831337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.833306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.842997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dfb3a-2c07-4e2a-9f36-d3c242b76b29 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.847685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1083/2156] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:07:39.849065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.858417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.859373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.859722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.860133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.861563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.864302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2992-7184-4fbe-be98-e5d9d1334109 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.865110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.870997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.872122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.872643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.873011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.874030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.877362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.961749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1074/2157] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:39.965626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:39.976371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65174e8-9300-4204-b41e-9ebc88f2e629 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:39.981268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:39.982303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:39.982659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:39.985079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:39.985079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:39.986894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:39.994334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1084/2158] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:39 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:39.998204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.008512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193b00-aed1-4d71-b87e-6ba391a813ef admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.016558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1075/2159] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:40.016721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.016721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.016721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.016721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.017021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.018053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.020044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.029635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1085/2160] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:40.034506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.046214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071705d9-285f-4ffa-8ce6-20890117de8b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.049626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c4d-c981-4696-a8e3-7855c6cc4e91 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.051560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.052542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.053201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.053794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] PATH_INFO: `/v3/projects/95ac4f9d5bfb4054a11599b805691b94/users/fb0c4ddb47874e61a2ef32002f7f2843/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.059882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.059882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.059882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.059882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.060814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.063080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.073887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ac4f9d5bfb4054a11599b805691b94, user_id=fb0c4ddb47874e61a2ef32002f7f2843, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.077199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.085922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1076/2161] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:40.087148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.098817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b437-f4c6-43fe-afcd-cf9142f03951 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.104663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.105959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.106416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.106697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] PATH_INFO: `/v3/projects/cd6668a120d541a4b155b6dad12a55dc/users/6b718dd4797547b885bb8817f2e9b29c/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.129658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6668a120d541a4b155b6dad12a55dc, user_id=6b718dd4797547b885bb8817f2e9b29c, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.133298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0ff88-6bfe-4f49-8bdf-dee71dcab5be admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.155999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1086/2162] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:40 2022] PUT /identity/v3/projects/95ac4f9d5bfb4054a11599b805691b94/users/fb0c4ddb47874e61a2ef32002f7f2843/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:40.159992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.217987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1077/2163] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:40 2022] PUT /identity/v3/projects/cd6668a120d541a4b155b6dad12a55dc/users/6b718dd4797547b885bb8817f2e9b29c/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:40.296937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.297282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.297526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.315842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384ffe-a06c-43a4-8df1-00a0b83fdf24 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.336025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] MFA Rules not processed for user `6b718dd4797547b885bb8817f2e9b29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:40.336025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:40.462705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.463988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.464276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.464552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.465284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.467144 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.478672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1078/2164] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:40.483359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.484664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1087/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:40.493295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.508185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e0a3-af76-4ceb-9ca2-0b79ad02c7ea None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.513100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82ee3-dd36-431c-9f77-19a6815ebf51 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.519461 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.520647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.520934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.521209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.521929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.527137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.528071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.528516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.528883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.529753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] PATH_INFO: `/v3/projects/95ac4f9d5bfb4054a11599b805691b94/users/fb0c4ddb47874e61a2ef32002f7f2843/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.533941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ac4f9d5bfb4054a11599b805691b94, user_id=fb0c4ddb47874e61a2ef32002f7f2843, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.538809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5139-bfdb-44e1-b8a5-f70a65106c5a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.576033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1088/2166] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:40 2022] PUT /identity/v3/projects/95ac4f9d5bfb4054a11599b805691b94/users/fb0c4ddb47874e61a2ef32002f7f2843/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:40.592324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.592734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.593216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.631882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] MFA Rules not processed for user `fb0c4ddb47874e61a2ef32002f7f2843`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:40.633748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:40.676650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1079/2167] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:40 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:40.678100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.789844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1089/2168] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:40.804410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e603e9-f553-487e-b115-0ddddfbc8fc5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.810506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.811983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:40.815475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.820085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.821917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.821917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.823623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:40.825716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:40.923921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9670e5-c755-4ca2-a9ec-7360b6192c22 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.938794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1080/2169] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:40 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:07:40.940520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:40.967703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0131b-c41c-46b9-93e5-45412a979ca7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:40.990442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.991184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.991547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.991936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.996328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:40.997011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:40.997290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:40.997591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:40.998327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.000016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.025082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1081/2170] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:41.026329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:41.047922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d047-4dbe-41d0-b6bd-51781273167b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:41.067105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:41.068191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:41.068652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:41.068934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] PATH_INFO: `/v3/projects/844ab91977f3418c882089729458fecd/users/3bc311b4220a42a3b7199fd00a1dd0e6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:41.090359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.092175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.098948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844ab91977f3418c882089729458fecd, user_id=3bc311b4220a42a3b7199fd00a1dd0e6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.101693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.104810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1090/2171] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:41.186003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1082/2172] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:41 2022] PUT /identity/v3/projects/844ab91977f3418c882089729458fecd/users/3bc311b4220a42a3b7199fd00a1dd0e6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:41.187785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:41.208745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac851a01-9932-4aca-8c9b-c1cb5200f905 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:41.337786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:41.339337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:41.339944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:41.340483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:41.342055 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.344435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41b4cf-9cfc-4545-a632-aaa5c99989d5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.363400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1091/2173] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:41.367491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:41.390197 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa20e-bc97-4511-b97d-3a255974f911 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:41.403382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:41.404346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:41.404626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:41.404902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] PATH_INFO: `/v3/projects/844ab91977f3418c882089729458fecd/users/3bc311b4220a42a3b7199fd00a1dd0e6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:41.421754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844ab91977f3418c882089729458fecd, user_id=3bc311b4220a42a3b7199fd00a1dd0e6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.424892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.472561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1083/2174] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:41 2022] PUT /identity/v3/projects/844ab91977f3418c882089729458fecd/users/3bc311b4220a42a3b7199fd00a1dd0e6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:41.483332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:41.485160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:41.485555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:41.524377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] MFA Rules not processed for user `3bc311b4220a42a3b7199fd00a1dd0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:41.526224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:41.628223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1092/2175] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:41.649479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:41.652067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:41.715693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338526d-5829-45a6-a117-7a07892a64c3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:41.719223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:41.722677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:41.722677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:41.722677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:41.780352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:41.782081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:41.792546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1084/2176] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:42.440223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:42.473845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be195-2276-43ec-94c6-66d14d40988a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:42.478639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0c4ddb47874e61a2ef32002f7f2843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ac4f9d5bfb4054a11599b805691b94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:42.479412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:42.480709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:42.480709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:42.480709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:42.481086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:42.482684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:42.498365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1093/2177] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:42.502762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:42.527965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8e80-4e25-4111-8128-ed255d381295 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:42.533952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0c4ddb47874e61a2ef32002f7f2843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ac4f9d5bfb4054a11599b805691b94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:42.535201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:42.535494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:42.535772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:42.536584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:42.540290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:42.656747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1085/2178] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:42 2022] POST /identity/v3/projects => generated 353 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:42.661226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:42.671119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eba0f-6ebd-440a-9409-15c35f1af8a2 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:42.725308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0c4ddb47874e61a2ef32002f7f2843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ac4f9d5bfb4054a11599b805691b94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:42.725998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:42.726336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:42.726618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:42.727334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:42.727641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:42.729267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:42.741419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1094/2179] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:42.779998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:42.791372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fc03c-33a3-476f-a0fc-c1f62853b49d tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:42.797691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0c4ddb47874e61a2ef32002f7f2843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ac4f9d5bfb4054a11599b805691b94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:42.799168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:42.799457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:42.799732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] PATH_INFO: `/v3/projects/d61dffb1013e42eaa572c7e22f4f1675` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:42.801262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d61dffb1013e42eaa572c7e22f4f1675)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:42.804929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:42.966690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61dffb1013e42eaa572c7e22f4f1675', 'request_id': 'req-9e967faa-80cb-4b50-bfb6-e521e0377dd9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:42.973866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61dffb1013e42eaa572c7e22f4f1675', 'request_id': 'req-9e967faa-80cb-4b50-bfb6-e521e0377dd9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:42.979822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61dffb1013e42eaa572c7e22f4f1675', 'request_id': 'req-9e967faa-80cb-4b50-bfb6-e521e0377dd9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:43.074933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] The token cache is being invalidate because project d61dffb1013e42eaa572c7e22f4f1675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:43.075224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:43.075923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:43.077661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1086/2180] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:42 2022] DELETE /identity/v3/projects/d61dffb1013e42eaa572c7e22f4f1675 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:43.718018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:43.719916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:43.784207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29416-264b-4649-b95e-e155d5ef74f7 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:43.842479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:43.842637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:43.843153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:43.843153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:43.843153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] PATH_INFO: `/v3/users/996a09358d2b4870ace60d25062508a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:43.843866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=996a09358d2b4870ace60d25062508a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:43.844544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:43.846377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:43.859200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e967faa-80cb-4b50-bfb6-e521e0377dd9 tempest-VolumeQuotaClassesTest-1312813182 tempest-VolumeQuotaClassesTest-1312813182-project-admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:43.864591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:43.865703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:43.866045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:43.866386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] PATH_INFO: `/v3/users/b3c353ed36d34401ab2fb163b69ee461` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:43.867881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c353ed36d34401ab2fb163b69ee461)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:43.869963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:44.049918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c353ed36d34401ab2fb163b69ee461'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.076266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996a09358d2b4870ace60d25062508a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.148708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c353ed36d34401ab2fb163b69ee461'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.161626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c353ed36d34401ab2fb163b69ee461'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.163212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c353ed36d34401ab2fb163b69ee461'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.163212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-91a3684c-41c7-4f8b-bd5a-63c5a5b8e73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c353ed36d34401ab2fb163b69ee461'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.174759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1087/2181] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:43 2022] DELETE /identity/v3/users/b3c353ed36d34401ab2fb163b69ee461 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:44.179105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.179392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.179665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:44.196813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:44.198055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.212044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996a09358d2b4870ace60d25062508a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.225598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996a09358d2b4870ace60d25062508a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.226440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996a09358d2b4870ace60d25062508a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.234267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-569e2f65-89ac-4ee0-9c45-b2861f4b6a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996a09358d2b4870ace60d25062508a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.240381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1095/2182] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:43 2022] DELETE /identity/v3/users/996a09358d2b4870ace60d25062508a1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:44.244621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.244911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.245187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:44.256525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1088/2183] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:44.264125 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:44.265931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.266571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:44.268442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.324591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1096/2184] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:44.328456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1891-5102-487f-b7cd-26a271c408a7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:44.335165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:44.336933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.382647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:44.383462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.384099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.384099 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:44.394535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456733-947a-421a-884a-3cb00b5559f8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:44.394906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:44.396602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:44.398405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:44.399048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.399326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.399596 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:44.408962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1089/2185] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:44.410545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:44.412059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:44.422889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1097/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:44.703662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:44.711193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.733988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fade394-93cc-4fc5-a70c-625f05992ab1 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:44.750107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:44.751243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.752085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.752364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] PATH_INFO: `/v3/projects/095c1f7ad2ef48a1a0cac96c0860cf64` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:44.753611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=095c1f7ad2ef48a1a0cac96c0860cf64)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:44.755655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:44.887580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095c1f7ad2ef48a1a0cac96c0860cf64', 'request_id': 'req-5673fb76-1ba9-46bd-8678-3e88f2320b1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.893791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095c1f7ad2ef48a1a0cac96c0860cf64', 'request_id': 'req-5673fb76-1ba9-46bd-8678-3e88f2320b1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.899157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095c1f7ad2ef48a1a0cac96c0860cf64', 'request_id': 'req-5673fb76-1ba9-46bd-8678-3e88f2320b1d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.911462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:44.913821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:44.930066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341097f9-dd2c-4136-9e67-4bac79df9f7d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:44.985221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] The token cache is being invalidate because project 095c1f7ad2ef48a1a0cac96c0860cf64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:44.991583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.991583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5673fb76-1ba9-46bd-8678-3e88f2320b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:44.991583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1090/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:44 2022] DELETE /identity/v3/projects/095c1f7ad2ef48a1a0cac96c0860cf64 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:44.996031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ea41-a67d-452a-bd73-572b172035e3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:44.996402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ea41-a67d-452a-bd73-572b172035e3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:44.996907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ea41-a67d-452a-bd73-572b172035e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.020983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f337ea41-a67d-452a-bd73-572b172035e3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:45.021131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.021974 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.022258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.022534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] PATH_INFO: `/v3/projects/e34b7f4f913c44dabb3b6afcacf825d4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.023149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f337ea41-a67d-452a-bd73-572b172035e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.023769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34b7f4f913c44dabb3b6afcacf825d4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.026139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.035415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1091/2188] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:45.044032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.044424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.044857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.070994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:45.072196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.080171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1092/2189] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:45.081561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.082657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.139140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c1ef0-dae0-4641-a16e-f4afc87ed241 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.143255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34b7f4f913c44dabb3b6afcacf825d4', 'request_id': 'req-df97244f-9f03-4436-b6c7-0356737b6a93'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.149744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34b7f4f913c44dabb3b6afcacf825d4', 'request_id': 'req-df97244f-9f03-4436-b6c7-0356737b6a93'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.155395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34b7f4f913c44dabb3b6afcacf825d4', 'request_id': 'req-df97244f-9f03-4436-b6c7-0356737b6a93'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.186500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.187142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.187424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.187703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.190065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.223334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] The token cache is being invalidate because project e34b7f4f913c44dabb3b6afcacf825d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:45.223624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.224246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.226635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1098/2190] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:44 2022] DELETE /identity/v3/projects/e34b7f4f913c44dabb3b6afcacf825d4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:45.227608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.230445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.248942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.250478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.259665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1093/2191] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:45.260235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.261532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.327003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97244f-9f03-4436-b6c7-0356737b6a93 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.333574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.334415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.334986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f139a4-5df7-4c3e-93ae-2b2489b378c8 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.335186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.335560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.336750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:45.337378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.339611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.340610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.341645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.342005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.342355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] PATH_INFO: `/v3/users/fb0c4ddb47874e61a2ef32002f7f2843` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.343686 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0c4ddb47874e61a2ef32002f7f2843)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.346298 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.359556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1099/2192] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:45.360977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.374896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cba8f-7ba7-457b-9b27-a1b2064e4a7c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.384932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.385656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.385936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.386209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.386903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.388949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.497794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1100/2193] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:45 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:45.499134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.558654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0b007-e4e2-46a5-8b44-22ecd72d6328 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.563380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.564179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.564352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.564701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.565364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.567522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.647644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0c4ddb47874e61a2ef32002f7f2843'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.709781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1101/2194] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:45 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:45.713822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.723847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30fcf7-49d6-46f7-b915-9f915f1f61d2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.728496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.729111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.729403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.729707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.730513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.732095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0c4ddb47874e61a2ef32002f7f2843'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.732230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.743225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1102/2195] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:45.746791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.750201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0c4ddb47874e61a2ef32002f7f2843'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.751172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0c4ddb47874e61a2ef32002f7f2843'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.752354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0c4ddb47874e61a2ef32002f7f2843'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:45.757916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0d2f-8eec-4c00-8663-32c1ed6e469a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.762948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.763810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.764250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.764519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.765563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.767725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1094/2196] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:45 2022] DELETE /identity/v3/users/fb0c4ddb47874e61a2ef32002f7f2843 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:45.767852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e57f9-fb92-408d-b8be-304536a32b1b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:45.796674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1103/2197] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:45.800681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:45.802352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:45.879390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1c78-b601-4a59-bd06-b2619859c377 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:45.886130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:45.887185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:45.887322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:45.887572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] PATH_INFO: `/v3/projects/eaaaea4c0b804109a132bd2056bb5dc7/users/f8a819e863144d3c9c6349ac28c7bdfb/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:45.903398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaaea4c0b804109a132bd2056bb5dc7, user_id=f8a819e863144d3c9c6349ac28c7bdfb, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:45.906147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:46.191966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1095/2198] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:45 2022] PUT /identity/v3/projects/eaaaea4c0b804109a132bd2056bb5dc7/users/f8a819e863144d3c9c6349ac28c7bdfb/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:46.202383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.203349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.203711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.243517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] MFA Rules not processed for user `f8a819e863144d3c9c6349ac28c7bdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:46.244921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:46.311033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1104/2199] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:46.324735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:46.324905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:46.358049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:46.359957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:46.412116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ed7b2-1766-4f40-b0ae-c364cd905734 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:46.416169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:46.416872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.420774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.420774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.426652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:46.428184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8130283-1e9e-4328-a3f4-27606cfefbf4 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:46.437096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1096/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:46.453932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317708-d7a7-4d72-8538-5d869317a809 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:46.463019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:46.463960 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.464242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.464517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] PATH_INFO: `/v3/projects/95ac4f9d5bfb4054a11599b805691b94` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.465754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ac4f9d5bfb4054a11599b805691b94)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:46.467696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:46.591152 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ac4f9d5bfb4054a11599b805691b94', 'request_id': 'req-5df20814-53a8-46e1-8bc8-924c119f9f10'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:46.601712 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ac4f9d5bfb4054a11599b805691b94', 'request_id': 'req-5df20814-53a8-46e1-8bc8-924c119f9f10'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:46.608060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ac4f9d5bfb4054a11599b805691b94', 'request_id': 'req-5df20814-53a8-46e1-8bc8-924c119f9f10'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:46.680936 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] The token cache is being invalidate because project 95ac4f9d5bfb4054a11599b805691b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:46.681290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:46.682354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5df20814-53a8-46e1-8bc8-924c119f9f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:46.684227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1105/2201] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:46 2022] DELETE /identity/v3/projects/95ac4f9d5bfb4054a11599b805691b94 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:46.689938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.690227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.690503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.733652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:46.739552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:46.832699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1097/2202] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:46.844205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.844205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.844205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.870408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:46.872745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:46.883845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1106/2203] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:46.889068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:46.899940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e727b-1e3c-4142-9302-77cb050c6f7e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:46.905265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:46.906023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.906401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.906751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.908175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:46.908552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:46.910257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:46.931378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1098/2204] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:46.933048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:46.944610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5684-a384-4395-8a2b-926e20972920 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:46.949877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:46.951370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:46.951809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:46.952228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:46.953405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:46.955790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.051053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1107/2205] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:46 2022] POST /identity/v3/projects => generated 409 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:47.054959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.069798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0766f-56c2-4b7c-9b1d-92ef3fdd6401 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.139240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.139915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.140198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.140472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.141192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.143914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.210434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.212254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:47.271100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fc58-84b7-4562-b34e-92608f0542f0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.274951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.275602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.275879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.276153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.277986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:47.291087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1099/2206] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:47 2022] POST /identity/v3/users => generated 305 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:47.292523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.304963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03d95-6698-4847-ad09-b78a5c81d107 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.311094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.312055 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.312443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.313023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.314031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.315828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.330231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1100/2207] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:47.331577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.341513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2baf4-46a4-4c49-bfe5-57cdd3c3175f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.346578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.349541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.349715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.349840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.349840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.349840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.349840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.351697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13079c80-052c-4f7a-8b6b-04925bca684a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.359666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1108/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:47.375411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1101/2209] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:47.383487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.395614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958b38-1edb-4de4-96da-4a53cb773c0e service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.400687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.401617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.405601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.405601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] PATH_INFO: `/v3/projects/220b9a5756d94318beaf21570f70c267/users/324a7d15fea44297b1df4c58f3d5ab2e/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.419591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] RBAC: Authorizing `identity:create_grant(project_id=220b9a5756d94318beaf21570f70c267, user_id=324a7d15fea44297b1df4c58f3d5ab2e, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.422431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.522143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1109/2210] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:47 2022] PUT /identity/v3/projects/220b9a5756d94318beaf21570f70c267/users/324a7d15fea44297b1df4c58f3d5ab2e/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:47.533201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.533863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.534264 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.560497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] MFA Rules not processed for user `324a7d15fea44297b1df4c58f3d5ab2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:47.561920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:47.657764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1102/2211] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:47.658925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.758772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424ac5-d491-426c-b5fb-7052541192af admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.758772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.758772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.758772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.759591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.759591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.759591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:47.827617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1110/2212] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:47 2022] POST /identity/v3/projects => generated 407 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:47.828780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:47.840100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef37b3d-82d7-459e-9bfa-9524d4c8706b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:47.898088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:47.898692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:47.898981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:47.899268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:47.899956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:47.901916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.007583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1103/2213] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:47 2022] POST /identity/v3/users => generated 310 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:48.011864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.023115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3851-b0cd-4643-a7de-7e47899328bc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.028096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.031895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.031895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.031895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.031895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:48.031895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.043077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1111/2214] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:48.047513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.058247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90421c9-dff8-4c68-b3b6-0a52c5aafe25 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.062882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.064386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.064669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.064944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] PATH_INFO: `/v3/projects/585ac631788d4278ae8b47a1d9968f20/users/af161024ffc348459baad70e25f6ac61/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.080444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ac631788d4278ae8b47a1d9968f20, user_id=af161024ffc348459baad70e25f6ac61, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:48.083247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.236329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1104/2215] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:48 2022] PUT /identity/v3/projects/585ac631788d4278ae8b47a1d9968f20/users/af161024ffc348459baad70e25f6ac61/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:48.240099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.251978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ef29-dd7c-46c9-aa28-db9c8d791926 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.309401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.310102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.310387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.310662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.311387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:48.313003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fca541-22bb-4a58-b895-ebf406b33259 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.325014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1112/2216] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:48.329157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.339238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c64f7-6d73-4066-b778-1c3b66cea160 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.343971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.345407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.345723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.346004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] PATH_INFO: `/v3/projects/585ac631788d4278ae8b47a1d9968f20/users/af161024ffc348459baad70e25f6ac61/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.351702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ac631788d4278ae8b47a1d9968f20, user_id=af161024ffc348459baad70e25f6ac61, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:48.354395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.366165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1105/2217] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:48 2022] PUT /identity/v3/projects/585ac631788d4278ae8b47a1d9968f20/users/af161024ffc348459baad70e25f6ac61/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:48.376454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.376819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.377279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.404086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] MFA Rules not processed for user `af161024ffc348459baad70e25f6ac61`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:48.405322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:48.472750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1113/2218] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:48.483668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.537816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8b6df-0a99-4e63-bb49-6203dac025e0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.541596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.542234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.542515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.542790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:48.552668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:48.554484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:48.564005 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1106/2219] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:07:48.962091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:48.963625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:48.977096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9583ea-dfd1-4448-be8f-f253a83a4155 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:48.982014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:48.983163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:48.983275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:48.983585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:49.042070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:49.043511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde3d7e-cfaf-47ff-b2bb-f272071163dc service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:49.052774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1114/2220] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:55.906414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:55.908390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:55.972728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c692ab-b061-4f28-a3a1-854622db3436 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:55.977229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:55.978129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:55.978409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:55.978682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] PATH_INFO: `/v3/users/2abe0ff43a18414e9bacb2be3e7f4117` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:55.979866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abe0ff43a18414e9bacb2be3e7f4117)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:55.981842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:56.196032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abe0ff43a18414e9bacb2be3e7f4117'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:56.314296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abe0ff43a18414e9bacb2be3e7f4117'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:56.326709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abe0ff43a18414e9bacb2be3e7f4117'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:56.327553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abe0ff43a18414e9bacb2be3e7f4117'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:56.329109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abe0ff43a18414e9bacb2be3e7f4117'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:56.340698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1107/2221] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:55 2022] DELETE /identity/v3/users/2abe0ff43a18414e9bacb2be3e7f4117 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:56.345811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:56.346293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:56.346415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:56.366991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:56.368197 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:56.426704 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1115/2222] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:56.436509 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:56.438042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:56.499229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6cdf1-9468-40de-bfcc-a9eb86ff3ffe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:56.506348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:56.507038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:56.507377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:56.507663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:56.524467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:56.524467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:56.531307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1108/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:57.013203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:57.014805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:57.027940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4dbaf-1c89-4d27-86ea-8e6424160f35 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:57.032942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:57.033837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:57.034675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:57.034675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] PATH_INFO: `/v3/projects/f066b5271f024324be4197e743866d04` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:57.035613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f066b5271f024324be4197e743866d04)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:57.037570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:57.241783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f066b5271f024324be4197e743866d04', 'request_id': 'req-2912a9fb-e598-4e4c-92f7-6375ff951efd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.249014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f066b5271f024324be4197e743866d04', 'request_id': 'req-2912a9fb-e598-4e4c-92f7-6375ff951efd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.255065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f066b5271f024324be4197e743866d04', 'request_id': 'req-2912a9fb-e598-4e4c-92f7-6375ff951efd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.354950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] The token cache is being invalidate because project f066b5271f024324be4197e743866d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:57.355572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.356136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.358511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1116/2224] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:57 2022] DELETE /identity/v3/projects/f066b5271f024324be4197e743866d04 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:57.363532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:57.373089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7624-57f3-413e-9735-892e738581e0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:57.428183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:57.429134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:57.429415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:57.429707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] PATH_INFO: `/v3/users/6b718dd4797547b885bb8817f2e9b29c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:57.430884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b718dd4797547b885bb8817f2e9b29c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:57.432799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:57.550967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:57.552347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:57.565011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912a9fb-e598-4e4c-92f7-6375ff951efd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:57.569638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:57.570547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:57.570878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:57.571150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] PATH_INFO: `/v3/users/f8a819e863144d3c9c6349ac28c7bdfb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:57.572317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a819e863144d3c9c6349ac28c7bdfb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:57.574268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:57.646405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b718dd4797547b885bb8817f2e9b29c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.742527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b718dd4797547b885bb8817f2e9b29c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.754349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b718dd4797547b885bb8817f2e9b29c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.755004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b718dd4797547b885bb8817f2e9b29c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.755646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-749e0f70-5fe1-4bca-b28f-b528dfeb02dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b718dd4797547b885bb8817f2e9b29c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.768012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1109/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:57 2022] DELETE /identity/v3/users/6b718dd4797547b885bb8817f2e9b29c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:57.786828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a819e863144d3c9c6349ac28c7bdfb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.925649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a819e863144d3c9c6349ac28c7bdfb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.938443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a819e863144d3c9c6349ac28c7bdfb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.939141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a819e863144d3c9c6349ac28c7bdfb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.946487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a819e863144d3c9c6349ac28c7bdfb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:57.952583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1117/2226] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:57 2022] DELETE /identity/v3/users/f8a819e863144d3c9c6349ac28c7bdfb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:57.957904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:57.958192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:57.958511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:57.975784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:57.977239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:58.040519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1110/2227] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:58.051990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:58.054140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:58.124389 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb9f4-0086-4a07-bcbe-0d8aa51255b9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:58.128858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:58.129581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:58.129864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:58.130563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:58.139703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:58.141175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:58.151283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1118/2228] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:07:58.317887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:58.319670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:58.332669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126016-6d85-497f-99a9-d144c22970cd None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:58.338152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:58.339287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:58.339614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:58.339890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] PATH_INFO: `/v3/projects/cd6668a120d541a4b155b6dad12a55dc` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:58.341208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6668a120d541a4b155b6dad12a55dc)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:58.343397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:58.498297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6668a120d541a4b155b6dad12a55dc', 'request_id': 'req-e40de879-3a95-4538-b1ca-accf3264b1ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.504974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6668a120d541a4b155b6dad12a55dc', 'request_id': 'req-e40de879-3a95-4538-b1ca-accf3264b1ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.510814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6668a120d541a4b155b6dad12a55dc', 'request_id': 'req-e40de879-3a95-4538-b1ca-accf3264b1ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.605491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] The token cache is being invalidate because project cd6668a120d541a4b155b6dad12a55dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:58.605912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.606646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.608705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1111/2229] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:58 2022] DELETE /identity/v3/projects/cd6668a120d541a4b155b6dad12a55dc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:58.612946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:58.622861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60c5a-11d7-4c3f-b473-17613d0f5edd service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:58.682360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:58.683293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:58.683662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:58.683973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] PATH_INFO: `/v3/users/3bc311b4220a42a3b7199fd00a1dd0e6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:58.685227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc311b4220a42a3b7199fd00a1dd0e6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:58.687403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:58.812833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:58.814303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:58.829792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40de879-3a95-4538-b1ca-accf3264b1ca admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:58.835486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:58.836479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:58.836890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:58.837107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] PATH_INFO: `/v3/projects/eaaaea4c0b804109a132bd2056bb5dc7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:58.838708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaaea4c0b804109a132bd2056bb5dc7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:58.840857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:58.927369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc311b4220a42a3b7199fd00a1dd0e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.959965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaaea4c0b804109a132bd2056bb5dc7', 'request_id': 'req-049c8afb-5682-43e8-9b2d-4472b033bea4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.966079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaaea4c0b804109a132bd2056bb5dc7', 'request_id': 'req-049c8afb-5682-43e8-9b2d-4472b033bea4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.971467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaaea4c0b804109a132bd2056bb5dc7', 'request_id': 'req-049c8afb-5682-43e8-9b2d-4472b033bea4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:58.999765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc311b4220a42a3b7199fd00a1dd0e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.012605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc311b4220a42a3b7199fd00a1dd0e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.013194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc311b4220a42a3b7199fd00a1dd0e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.020500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8e8ca83-2173-425a-bb32-797f9e33e7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc311b4220a42a3b7199fd00a1dd0e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.026394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1119/2230] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:07:58 2022] DELETE /identity/v3/users/3bc311b4220a42a3b7199fd00a1dd0e6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:59.142553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] The token cache is being invalidate because project eaaaea4c0b804109a132bd2056bb5dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:59.142846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.143546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-049c8afb-5682-43e8-9b2d-4472b033bea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.145194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1112/2231] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:58 2022] DELETE /identity/v3/projects/eaaaea4c0b804109a132bd2056bb5dc7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:07:59.150313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.150608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.150915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.169362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:59.170608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:59.231446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1120/2232] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:59.241133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.241419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.241729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.261420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:59.262748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:59.271293 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1113/2233] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:07:59.280785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.291722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36d9c4-9aa2-4d4d-a3b5-5a4197f6e2ee None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.297071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.297761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.298041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.298364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.299032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:07:59.299830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.301428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.317472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1121/2234] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:07:59.319887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.329639 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eccaa-2f97-4148-b809-76b57fc8de45 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.334379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.335061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.335311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.336420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.336420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.338424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.425689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1114/2235] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:07:59 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:59.430051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.441116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c6fb-e1eb-42a2-ac0b-1d91a8aebaac admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.498033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.505818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.505818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.505818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.505818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.505818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.585291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.587324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:59.608512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d1fa-f3dc-4866-84ff-ad4ddcaef8a6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.614481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.615408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.615688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.615898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1122/2236] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:07:59 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:07:59.616427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] PATH_INFO: `/v3/projects/844ab91977f3418c882089729458fecd` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.617168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=844ab91977f3418c882089729458fecd)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.619267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.619598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.630663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa71e29-78a6-45df-9494-18a5d12978c7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.635502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.639338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.639338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.639338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.639338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.639338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.649771 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1123/2237] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:07:59.654033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.664083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f244-1fca-45e1-8ca7-5fc4090f0d39 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.668934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.669623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.669923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.670177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.670884 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.672547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.684086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1124/2238] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:07:59.688110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.697643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1db54-a3e0-4b0a-8e74-aebbe39a39ca admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:07:59.702295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:07:59.703148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.703431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.703708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] PATH_INFO: `/v3/projects/ac193dba6f144099ab5e70bc38c8c0a0/users/93edd5588db648ae9d5be8f20f60d6e6/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.718497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac193dba6f144099ab5e70bc38c8c0a0, user_id=93edd5588db648ae9d5be8f20f60d6e6, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:07:59.722129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e94487-a54f-4d42-93b8-d9955ffde4ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:07:59.733328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844ab91977f3418c882089729458fecd', 'request_id': 'req-85b356c7-d49d-43a7-9f60-ff04d47773ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.741167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844ab91977f3418c882089729458fecd', 'request_id': 'req-85b356c7-d49d-43a7-9f60-ff04d47773ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.746982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844ab91977f3418c882089729458fecd', 'request_id': 'req-85b356c7-d49d-43a7-9f60-ff04d47773ca'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.852862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1125/2239] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:07:59 2022] PUT /identity/v3/projects/ac193dba6f144099ab5e70bc38c8c0a0/users/93edd5588db648ae9d5be8f20f60d6e6/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:59.858420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:07:59.858729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:07:59.859032 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:07:59.877121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:07:59.883357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:07:59.883484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] The token cache is being invalidate because project 844ab91977f3418c882089729458fecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:07:59.883484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.883484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:07:59.883484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1115/2240] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:07:59 2022] DELETE /identity/v3/projects/844ab91977f3418c882089729458fecd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:07:59.955353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1126/2241] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:07:59.967532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:07:59.969115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:00.040938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b356c7-d49d-43a7-9f60-ff04d47773ca admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:00.095228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:00.095897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:00.096822 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:00.097123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:00.106418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:00.108125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6ca63-daa0-4a69-9299-35528ec0a7d8 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:00.117927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1116/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:06.108627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.110383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.134598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8239-f165-43fb-b5cb-e3fc3906e63b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.141163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.142515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.143064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.143577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] PATH_INFO: `/v3/users/324a7d15fea44297b1df4c58f3d5ab2e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.143781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.144804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.145999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.146155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324a7d15fea44297b1df4c58f3d5ab2e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.148399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.186476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] MFA Rules not processed for user `93edd5588db648ae9d5be8f20f60d6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:06.187731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.260517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1117/2243] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:06.265155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.266754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.282539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c899-b924-47e4-988c-03840aebe41d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.288098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.288898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.289283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.289585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.290283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.292261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.369235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324a7d15fea44297b1df4c58f3d5ab2e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:06.407400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1118/2244] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:08:06 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:08:06.412245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.462131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324a7d15fea44297b1df4c58f3d5ab2e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:06.478896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898dbb-f8fd-42f2-8adb-60dd86ddf55c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.484863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.485380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324a7d15fea44297b1df4c58f3d5ab2e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:06.485596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.485881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.486194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.486310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324a7d15fea44297b1df4c58f3d5ab2e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:06.486900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.489020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.493720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4ec8b7ae-9247-4435-8046-fa4d9d6ed2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324a7d15fea44297b1df4c58f3d5ab2e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:06.500198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1127/2245] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:08:06 2022] DELETE /identity/v3/users/324a7d15fea44297b1df4c58f3d5ab2e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:06.505563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.505962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.506339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.527186 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:06.528242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.596407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1128/2246] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:06.606488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1119/2247] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:08:06 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:08:06.607002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.608982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.610773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.612950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:06.628242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae63ac-b422-4214-b95f-78729e935292 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.636521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.641357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.641357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.641357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.641357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.641357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.657380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1120/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:06.658386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.669263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d1f2-8784-418b-8e44-daaf175d8efc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.675802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.676640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.676951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.677361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] PATH_INFO: `/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c/users/3ff6b43dc77f4842b44bd7e1a55a9f97/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.679909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a2b18-7f36-4e17-a668-33a678818738 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.683769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.684414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.684698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.684973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.695230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.695612 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f51c354a0dd43cdb23ab619e5ce643c, user_id=3ff6b43dc77f4842b44bd7e1a55a9f97, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.696699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.698798 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.707497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1129/2249] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:06.774041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1121/2250] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:06 2022] PUT /identity/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c/users/3ff6b43dc77f4842b44bd7e1a55a9f97/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:06.778154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.789208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee41ce-e74b-44e7-b7a7-295f8d901988 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.851615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.852361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.852647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.852926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.853754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.855574 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.867323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1130/2251] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:08:06.871949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:06.883403 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc915070-1e91-4efb-a9d7-fdf17360c4c5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:06.888580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:06.889836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:06.889976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:06.890286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] PATH_INFO: `/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c/users/3ff6b43dc77f4842b44bd7e1a55a9f97/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:06.892395 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f51c354a0dd43cdb23ab619e5ce643c, user_id=3ff6b43dc77f4842b44bd7e1a55a9f97, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:06.896030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:06.908051 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1122/2252] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:06 2022] PUT /identity/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c/users/3ff6b43dc77f4842b44bd7e1a55a9f97/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:07.206554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:07.206554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:07.220763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ddcbc-6b22-4fe3-b8ef-276b6c953577 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:07.301098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:07.302178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:07.302466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:07.302761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] PATH_INFO: `/v3/projects/220b9a5756d94318beaf21570f70c267` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:07.304083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=220b9a5756d94318beaf21570f70c267)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:07.306304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:07.435416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220b9a5756d94318beaf21570f70c267', 'request_id': 'req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:07.443250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220b9a5756d94318beaf21570f70c267', 'request_id': 'req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:07.449466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220b9a5756d94318beaf21570f70c267', 'request_id': 'req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:07.554654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] The token cache is being invalidate because project 220b9a5756d94318beaf21570f70c267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:08:07.559239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:07.559239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:07.559239 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1131/2253] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:08:07 2022] DELETE /identity/v3/projects/220b9a5756d94318beaf21570f70c267 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:07.561730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:07.572174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:07.590578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517191-a01c-4490-98fa-980e2e65c28d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:07.660047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:07.663895 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:07.664533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:07.665049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] PATH_INFO: `/v3/users/af161024ffc348459baad70e25f6ac61` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:07.667013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af161024ffc348459baad70e25f6ac61)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:07.671035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:07.928866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af161024ffc348459baad70e25f6ac61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.017317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af161024ffc348459baad70e25f6ac61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.031048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af161024ffc348459baad70e25f6ac61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.031810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af161024ffc348459baad70e25f6ac61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.032495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ac7d3bff-3e6c-407a-a3bf-71dc2b15fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af161024ffc348459baad70e25f6ac61'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.048626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1123/2254] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:08:07 2022] DELETE /identity/v3/users/af161024ffc348459baad70e25f6ac61 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:08:08.584862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:08.597049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1e8b4-72bb-48bf-811b-1e17543cfb1c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:08.674674 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:08.675578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:08.675850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:08.676128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] PATH_INFO: `/v3/projects/585ac631788d4278ae8b47a1d9968f20` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:08.677465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585ac631788d4278ae8b47a1d9968f20)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:08.679478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:08.805592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585ac631788d4278ae8b47a1d9968f20', 'request_id': 'req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.814922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585ac631788d4278ae8b47a1d9968f20', 'request_id': 'req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.822706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585ac631788d4278ae8b47a1d9968f20', 'request_id': 'req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.924340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] The token cache is being invalidate because project 585ac631788d4278ae8b47a1d9968f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:08:08.924340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.928597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9cd121e4-4544-4e0e-89c6-2ba64c210dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:08.935395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1132/2255] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:08:08 2022] DELETE /identity/v3/projects/585ac631788d4278ae8b47a1d9968f20 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:08.937355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:08.937859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:08.938120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:08.973766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:08.986601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:09.061496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1124/2256] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:08:09.067699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.068004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.068354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.092196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:09.093853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:09.102726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1133/2257] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:09.107394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.118069 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c20327-506c-47e7-8a9c-20d645ef72c0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.123155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.123896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.124359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.124961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.125847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:08:09.126321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:09.128378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:09.145687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1125/2258] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:08:09.150751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.162146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881b50d-7a8f-497b-8e4e-21b8eee1b54a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.172480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.173476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.173911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.174555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.175443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:09.178308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:09.369980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1134/2259] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:08:09 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:09.374757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.387493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a698-fa6a-4721-aeb5-bc3eddbc7a22 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.482515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.483205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.483565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.483877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.486890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:09.494383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:09.841957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1126/2260] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:08:09 2022] POST /identity/v3/users => generated 291 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:09.846329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.878576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b4b8a-1f5d-4dc7-a7c5-62b819efa3ac admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.885635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.886769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.887208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.887631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.888539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:09.890853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:09.907756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1135/2261] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:09.911331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.927097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e18e6-eb2f-4a08-89ff-f82dfad2121d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.937313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.939451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.941414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.942631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:09.944263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:09.946156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d257c28-805e-45a4-9230-10b2cf7caf39 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:09.965343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1127/2262] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:09.970496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:09.989557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14740b-fd74-49ea-a5d7-1256f3962f3f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:09.997068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:09.998599 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:09.999079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:09.999613 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] PATH_INFO: `/v3/projects/c8d9601edd884019b21648f7b8dd8170/users/84a799c39b754b0f8152a825c1779a9c/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.032662 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d9601edd884019b21648f7b8dd8170, user_id=84a799c39b754b0f8152a825c1779a9c, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:10.041968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:10.191705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:10.192650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:10.193164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.194927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1136/2263] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:09 2022] PUT /identity/v3/projects/c8d9601edd884019b21648f7b8dd8170/users/84a799c39b754b0f8152a825c1779a9c/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:10.256596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] MFA Rules not processed for user `84a799c39b754b0f8152a825c1779a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:10.258037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:10.369417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1128/2264] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:10.373848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:10.474299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab234e9-9079-4789-9e9f-00ada8d70148 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:10.479513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:10.480201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:10.480520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:10.480830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.481584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:10.484021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:10.633533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1137/2265] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:08:10 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:10.637753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:10.661766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386798b4-112e-4032-b2f8-f8766860b54a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:10.737589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:10.738306 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:10.738821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:10.739100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.739897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:10.742112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:10.848925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1129/2266] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:08:10 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:10.852903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:10.865597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7c05-5bfd-4b79-9bd4-6b72b0e69837 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:10.870923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:10.871785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:10.872214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:10.872497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.873243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:10.875235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:10.887302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1138/2267] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:10.891730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:10.903672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689305d-b6db-4135-aa12-399d136a78ce admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:10.909322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:10.911212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:10.911584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:10.912583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] PATH_INFO: `/v3/projects/83d90afa35834099a96ba9d90357d3fb/users/dfec668892144ffd9d261b9c551fc284/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:10.930908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d90afa35834099a96ba9d90357d3fb, user_id=dfec668892144ffd9d261b9c551fc284, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:10.933884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:11.023549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1130/2268] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:10 2022] PUT /identity/v3/projects/83d90afa35834099a96ba9d90357d3fb/users/dfec668892144ffd9d261b9c551fc284/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:11.027979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:11.038896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99819-7cfb-47a3-b2ab-452994d35b34 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:11.103903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:11.105079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:11.105368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:11.105679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:11.106415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:11.108521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe0a95-4b75-40c8-b907-de1acb30c82f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:11.123549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1139/2269] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:11.124813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:11.142357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f295c75-7591-47e2-8a04-77b417fffcba admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:11.148841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:11.150129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:11.150500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:11.150859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] PATH_INFO: `/v3/projects/83d90afa35834099a96ba9d90357d3fb/users/dfec668892144ffd9d261b9c551fc284/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:11.153014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d90afa35834099a96ba9d90357d3fb, user_id=dfec668892144ffd9d261b9c551fc284, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:11.156417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:11.187981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:11.188546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:11.189049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:11.190784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1131/2270] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:11 2022] PUT /identity/v3/projects/83d90afa35834099a96ba9d90357d3fb/users/dfec668892144ffd9d261b9c551fc284/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:11.223235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] MFA Rules not processed for user `dfec668892144ffd9d261b9c551fc284`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:11.224874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:11.314456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1140/2271] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:11.326935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:11.328816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:11.403860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b1c7-c61d-49c1-ae8d-325e0dc0088c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:11.407723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:11.408620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:11.408921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:11.409173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:11.422874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:11.431054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495453d-e009-41be-90f7-13172f134bdd service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:11.437696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1132/2272] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:12.033242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:12.123685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887374b8-ca03-40e8-8fae-1ae60d02c632 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:12.129812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:12.131400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:12.131682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:12.132151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] PATH_INFO: `/v3/users/84a799c39b754b0f8152a825c1779a9c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:12.134073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a799c39b754b0f8152a825c1779a9c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:12.139897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:12.305697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a799c39b754b0f8152a825c1779a9c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:12.370283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a799c39b754b0f8152a825c1779a9c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:12.400061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a799c39b754b0f8152a825c1779a9c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:12.401042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a799c39b754b0f8152a825c1779a9c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:12.416069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a799c39b754b0f8152a825c1779a9c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:12.426059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1141/2273] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:08:12 2022] DELETE /identity/v3/users/84a799c39b754b0f8152a825c1779a9c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:12.427621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:12.428148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:12.428245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:12.447651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:12.448956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:12.545685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1133/2274] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:12.556794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:12.558342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:12.625265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2922e-0960-4a66-a261-ec0e94d707f3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:12.629813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:12.630474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:12.630763 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:12.631534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:12.641273 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:12.644113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98ff35-5df4-42cd-9a90-3c63c563f42b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:12.654011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1142/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:13.259493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:13.261929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:13.285175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011713c-0c01-4861-8d99-4b2c553fc105 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:13.292914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:13.293838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:13.294125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:13.294392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] PATH_INFO: `/v3/projects/c8d9601edd884019b21648f7b8dd8170` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:13.295792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d9601edd884019b21648f7b8dd8170)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:13.298146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:13.435692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:13.436256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:13.436256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:13.491482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d9601edd884019b21648f7b8dd8170', 'request_id': 'req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.492015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] MFA Rules not processed for user `3ff6b43dc77f4842b44bd7e1a55a9f97`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:13.492986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:13.500562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d9601edd884019b21648f7b8dd8170', 'request_id': 'req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.507976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d9601edd884019b21648f7b8dd8170', 'request_id': 'req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.590741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1143/2276] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:13.594291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] The token cache is being invalidate because project c8d9601edd884019b21648f7b8dd8170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:08:13.594663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.595379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.597588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1134/2277] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:08:13 2022] DELETE /identity/v3/projects/c8d9601edd884019b21648f7b8dd8170 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:13.602026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:13.614491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:13.616110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:13.673938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406987-8e8a-4b01-9fe9-762378c3dd85 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:13.679114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:13.680093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:13.680531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:13.680880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] PATH_INFO: `/v3/users/dfec668892144ffd9d261b9c551fc284` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:13.682272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfec668892144ffd9d261b9c551fc284)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:13.685505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:13.734817 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e312c0-5ba0-43fe-96fb-79a9ecac2ada admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:13.741034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:13.741790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:13.744089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:13.744089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:13.744409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:13.807665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:13.809304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:13.819268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1135/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:08:13.861332 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfec668892144ffd9d261b9c551fc284'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.925558 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfec668892144ffd9d261b9c551fc284'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.950238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfec668892144ffd9d261b9c551fc284'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.951107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfec668892144ffd9d261b9c551fc284'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.958862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d4f8de38-280f-47c3-a399-d05470291364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfec668892144ffd9d261b9c551fc284'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:13.965292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1144/2279] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:08:13 2022] DELETE /identity/v3/users/dfec668892144ffd9d261b9c551fc284 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:14.525086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:14.527973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:14.544312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14afb-df38-4dd5-b03f-58889f2b80d3 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:14.626258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:14.627318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:14.627690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:14.628063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] PATH_INFO: `/v3/projects/83d90afa35834099a96ba9d90357d3fb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:14.629385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d90afa35834099a96ba9d90357d3fb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:14.631413 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:14.742975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d90afa35834099a96ba9d90357d3fb', 'request_id': 'req-b4827566-a4c2-4aaf-8089-5fc2003d0095'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:14.749100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d90afa35834099a96ba9d90357d3fb', 'request_id': 'req-b4827566-a4c2-4aaf-8089-5fc2003d0095'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:14.755177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d90afa35834099a96ba9d90357d3fb', 'request_id': 'req-b4827566-a4c2-4aaf-8089-5fc2003d0095'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:14.810896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] The token cache is being invalidate because project 83d90afa35834099a96ba9d90357d3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:08:14.811300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:14.812035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b4827566-a4c2-4aaf-8089-5fc2003d0095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:08:14.813733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1136/2280] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:08:14 2022] DELETE /identity/v3/projects/83d90afa35834099a96ba9d90357d3fb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:14.819398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:14.819907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:14.820203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:14.838487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:14.839700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:14.900426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1145/2281] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:14.908561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:14.911571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:14.911571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:14.932770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:14.934053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:14.942802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1137/2282] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:14.947242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:14.958270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51623dc7-80e2-454a-a14a-85b0ec1a89cd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:14.965300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:14.967338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:14.967338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:14.967338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:14.967338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:08:14.967685 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:14.969357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:14.981709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1146/2283] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:08:14.986419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:14.996174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa912-ac34-4bb7-8455-7042a2b2b1c1 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.001407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.002198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.007533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.007533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.007533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.007533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.104582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1138/2284] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:08:14 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:15.109094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:15.121213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f25fd-b7a6-46a7-a531-5e5a673f20ae admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.178664 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.179334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.179644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.179930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.180691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.182698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.273956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1147/2285] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:08:15 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:08:15.278114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:15.288906 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dd-4f73-41d0-8d8e-96ef2b3577ac admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.293665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.294333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.294626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.294897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.295620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.297224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.307553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1139/2286] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:15.314561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:15.324405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bdf9c-dc21-4d16-b75c-f83556b65b33 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.329139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.329874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.330110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.330367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.331088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.333472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4c09-8574-45ca-82c9-0e52dab8b60f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.343622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1148/2287] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:08:15.348551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:15.359656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47a6f8-ac3b-49d4-be97-5160bab51e59 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.364349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.365222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.369087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.369087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] PATH_INFO: `/v3/projects/b1369aadeb564d2ab6afa040f4b82889/users/e7838513fd094f70a2c7c69176eff9d8/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.380375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1369aadeb564d2ab6afa040f4b82889, user_id=e7838513fd094f70a2c7c69176eff9d8, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.383247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.450048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1140/2288] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:08:15 2022] PUT /identity/v3/projects/b1369aadeb564d2ab6afa040f4b82889/users/e7838513fd094f70a2c7c69176eff9d8/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:08:15.459533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d07e1-6dc5-4a41-8396-4fbd66a5a2d7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.459829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d07e1-6dc5-4a41-8396-4fbd66a5a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.460177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d07e1-6dc5-4a41-8396-4fbd66a5a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.479083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a26d07e1-6dc5-4a41-8396-4fbd66a5a2d7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:15.489924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a26d07e1-6dc5-4a41-8396-4fbd66a5a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:15.545143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1149/2289] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:15.557339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:15.560216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:15.650399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fc916-ba29-4cae-a09f-278723f11139 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:15.655608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:15.656356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:15.656561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:15.657266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:15.669333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:15.671311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:15.681154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1141/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:16.988265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a11b4f-37d3-4850-95e6-e33683571c94 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:16.988784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a11b4f-37d3-4850-95e6-e33683571c94 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:16.988912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a11b4f-37d3-4850-95e6-e33683571c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:17.024862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d0a11b4f-37d3-4850-95e6-e33683571c94 None None] MFA Rules not processed for user `e7838513fd094f70a2c7c69176eff9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:17.026174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d0a11b4f-37d3-4850-95e6-e33683571c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:17.136345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1150/2291] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:17.148008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:17.149362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:17.208270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c247b6-abc6-45bf-b89a-fbb86b9d90da service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:17.211879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:17.212521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:17.212804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:17.213075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:17.222178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:17.223220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ac4e-1abe-4ef0-930e-4d38fcdb0ac2 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:17.232701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1142/2292] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:08:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:08:19.060162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b249c-a4ea-4cbf-8996-f0ea03a88cc5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:19.060649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b249c-a4ea-4cbf-8996-f0ea03a88cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:19.060740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b249c-a4ea-4cbf-8996-f0ea03a88cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:19.079312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3e1b249c-a4ea-4cbf-8996-f0ea03a88cc5 None None] MFA Rules not processed for user `e7838513fd094f70a2c7c69176eff9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:19.080506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e1b249c-a4ea-4cbf-8996-f0ea03a88cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:19.087508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1151/2293] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:39.189970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a3da-3253-44b9-81f6-a8d4400823dc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:39.190456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a3da-3253-44b9-81f6-a8d4400823dc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:39.190569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566a3da-3253-44b9-81f6-a8d4400823dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:39.209238 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e566a3da-3253-44b9-81f6-a8d4400823dc None None] MFA Rules not processed for user `e7838513fd094f70a2c7c69176eff9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:39.210423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e566a3da-3253-44b9-81f6-a8d4400823dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:39.217247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1143/2294] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:43.010470 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e499b-3342-4255-beac-57a5b2380f14 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:43.011097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e499b-3342-4255-beac-57a5b2380f14 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:43.011097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e499b-3342-4255-beac-57a5b2380f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:43.030089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e76e499b-3342-4255-beac-57a5b2380f14 None None] MFA Rules not processed for user `93edd5588db648ae9d5be8f20f60d6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:43.031386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e76e499b-3342-4255-beac-57a5b2380f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:43.094584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1152/2295] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:46.018585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:46.018585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:46.019231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:46.035988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] MFA Rules not processed for user `d2bd1b793a33487b834c4684b7c31231`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:46.037169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:46.097195 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1144/2296] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:08:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:52.915919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79865f-ef3d-4044-bad0-fa84978f317b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:52.916416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79865f-ef3d-4044-bad0-fa84978f317b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:52.916508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79865f-ef3d-4044-bad0-fa84978f317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:52.934354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2b79865f-ef3d-4044-bad0-fa84978f317b None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:08:52.935568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2b79865f-ef3d-4044-bad0-fa84978f317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:52.995121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1153/2297] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:08:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:08:53.155348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:08:53.158339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:08:53.226106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbe7da-2467-4e59-8e5a-141a0e5af65e None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:08:53.231416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:08:53.232090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:08:53.232374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:08:53.232648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:08:53.241008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:08:53.242716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:08:53.251021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1145/2298] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:09:10.179051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:10.179614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:10.179720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:10.198423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:10.199656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:10.207078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1154/2299] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:09:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:10.219134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:10.230945 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dd25f-11a7-4036-92c5-a9a7a201948d service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:10.235860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:10.236526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:10.236803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:10.237075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:10.245746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:10.247337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b307fa-de9d-4e3f-8f92-3efb21aa3bd0 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:10.258135 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1146/2300] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:09:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:09:12.386496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:12.387931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:12.400475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08026-3f1e-44cd-bb32-2f4910b90cfc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:12.405668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:12.406849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:12.407507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:12.408181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:12.411502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:12.499309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:12.500758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050fdd7-d27d-46a4-bfb6-ab1488426ab5 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:12.511803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1155/2301] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:16.708494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:16.710787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:16.710787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:16.713372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1147/2302] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:09:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:09:16.725603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6119-7ff8-43c1-b57e-8f8c70f649db None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:16.726576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6119-7ff8-43c1-b57e-8f8c70f649db None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:16.727064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6119-7ff8-43c1-b57e-8f8c70f649db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:16.801602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d89e6119-7ff8-43c1-b57e-8f8c70f649db None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:16.803225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d89e6119-7ff8-43c1-b57e-8f8c70f649db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:16.891909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1156/2303] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:09:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:09:16.907551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:16.909738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:17.010008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399d82-fc50-4a6b-946b-5b260235f271 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:17.014917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:17.015839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.016325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.016813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.033256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:17.035011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063063f4-80c6-4423-a311-fddc5882412a service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:17.050065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1148/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:17.230215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e432-a99b-49df-99da-ec6882401bac None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.230501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e432-a99b-49df-99da-ec6882401bac None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.230783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e432-a99b-49df-99da-ec6882401bac None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.233002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1157/2305] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:09:17.241012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04caf0-86fb-48ed-b14c-2a4e1745e17f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.241383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04caf0-86fb-48ed-b14c-2a4e1745e17f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.241832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04caf0-86fb-48ed-b14c-2a4e1745e17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.266224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1b04caf0-86fb-48ed-b14c-2a4e1745e17f None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:17.267464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1b04caf0-86fb-48ed-b14c-2a4e1745e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:17.275174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1149/2306] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:09:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:17.288447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e432-a99b-49df-99da-ec6882401bac None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:17.300609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e432-a99b-49df-99da-ec6882401bac None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:17.304338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:17.305079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.305520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.305872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.313992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:17.315623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a0cd2-6a46-4a6d-ae31-fd4ff1cdf8f2 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:17.324012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1158/2307] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:17.431097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d164-20f7-40e5-a6ff-0c50c65b8926 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.431635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d164-20f7-40e5-a6ff-0c50c65b8926 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.432059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d164-20f7-40e5-a6ff-0c50c65b8926 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.434031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1150/2308] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 06:09:17.440603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee222-0624-4031-a54a-d3d4bf252951 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.441098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee222-0624-4031-a54a-d3d4bf252951 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.441581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ee222-0624-4031-a54a-d3d4bf252951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.464579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a81ee222-0624-4031-a54a-d3d4bf252951 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:17.466105 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a81ee222-0624-4031-a54a-d3d4bf252951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:17.479638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1159/2309] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:09:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:17.493415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d164-20f7-40e5-a6ff-0c50c65b8926 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:17.504876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d164-20f7-40e5-a6ff-0c50c65b8926 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:17.509322 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:17.510213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:17.510644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:17.511077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:17.528031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:17.529728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:17.545344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1151/2310] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:09:21.820053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:21.820578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:21.822897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:21.844261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:21.846452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:21.859048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1160/2311] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:09:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:09:21.870908 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:21.882454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35cec-98ca-4cb6-ac41-47e500977f52 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:21.894589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:21.895254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:21.895536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:21.895810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:21.905496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:21.907116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2264-5f0d-41ed-a1c1-4ec4de9379c1 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:21.916967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1152/2312] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:09:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:09:22.738017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:22.750300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7b54c-88a1-4208-99be-6921954be348 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:22.765746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:22.766714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:22.767076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:22.767368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:22.770367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:22.792878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:22.794718 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:22.810816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1161/2313] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:27.845358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:27.846277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:27.846712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:27.867432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:27.868688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:27.876550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1153/2314] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:27.890280 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:27.913481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef0ed-fcec-4c34-aaba-c4bdebb02195 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:27.920835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:27.921586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:27.921869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:27.922191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:27.932650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:27.934924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:27.946008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1162/2315] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:09:31.327225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:31.341127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f3fe8-a8b3-4247-84b6-d5d20e5ba0cb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:31.351469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:31.352479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:31.352986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:31.353549 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] PATH_INFO: `/v3/users/e7838513fd094f70a2c7c69176eff9d8` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:31.355393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7838513fd094f70a2c7c69176eff9d8)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:31.357324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:31.528387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7838513fd094f70a2c7c69176eff9d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:31.577669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7838513fd094f70a2c7c69176eff9d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:31.590497 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7838513fd094f70a2c7c69176eff9d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:31.591171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7838513fd094f70a2c7c69176eff9d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:31.591771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f3a6ec35-35f0-4b82-a1a0-f24669f154bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7838513fd094f70a2c7c69176eff9d8'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:31.605408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1154/2316] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:09:31 2022] DELETE /identity/v3/users/e7838513fd094f70a2c7c69176eff9d8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:09:31.842614 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:31.859485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fd5f6-260c-4b42-b107-98c52549233e service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:31.924118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:31.925115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:31.925602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:31.927982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] PATH_INFO: `/v3/projects/b1369aadeb564d2ab6afa040f4b82889` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:31.927982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1369aadeb564d2ab6afa040f4b82889)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:31.929415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.032189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1369aadeb564d2ab6afa040f4b82889', 'request_id': 'req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:32.039476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1369aadeb564d2ab6afa040f4b82889', 'request_id': 'req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:32.046349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1369aadeb564d2ab6afa040f4b82889', 'request_id': 'req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:32.102090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] The token cache is being invalidate because project b1369aadeb564d2ab6afa040f4b82889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:09:32.102390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:32.103001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d1e5d6f6-c96a-44be-be82-3aee5cabb8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:32.105027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1163/2317] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:09:31 2022] DELETE /identity/v3/projects/b1369aadeb564d2ab6afa040f4b82889 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:09:32.109918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.110205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.110500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.138312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:32.139536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:32.204883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1155/2318] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:32.271354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.271643 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.271927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.290765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:32.291907 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:32.300439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1164/2319] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:32.304660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.314989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591cccb-178b-4582-98ca-432c66eb84b8 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.319568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.320218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.320503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.320779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.321539 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:09:32.321848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.323440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.334711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1156/2320] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:09:32.339033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.348481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1caf0-2cc4-4d0c-aec6-b0dce07597d9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.363817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.364617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.364957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.365304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.366128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.368164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.459628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1165/2321] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:09:32 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:09:32.463847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.474053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b81d9-30a2-4a18-a524-6ba195ea174f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.532344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.533255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.533640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.533921 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.534637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.536555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.613606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1157/2322] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:09:32 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:09:32.617737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.630689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef677eb-9d5f-493c-92fa-17b155505c77 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.636644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.637820 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.638284 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.638788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.640159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.642291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.658436 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1166/2323] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:09:32.663414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.675363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931119f-620a-428b-9258-cbade19758e4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.680859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.681792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.682292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.682652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.683427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.685095 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02402b5-0bb8-4079-bf42-982957d7ac46 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.697496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1158/2324] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:09:32.700844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.710655 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66a928-d353-49fd-80eb-47c62bb491f4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:32.715233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:32.716101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.716377 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.716648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] PATH_INFO: `/v3/projects/3cc866dccfd249e5bad0aed36fd03130/users/225c73a50e9d46218d695dbd4309aace/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.731947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc866dccfd249e5bad0aed36fd03130, user_id=225c73a50e9d46218d695dbd4309aace, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:32.735690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:32.847200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1167/2325] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:09:32 2022] PUT /identity/v3/projects/3cc866dccfd249e5bad0aed36fd03130/users/225c73a50e9d46218d695dbd4309aace/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:09:32.857876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:32.858162 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:32.860064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:32.893781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] MFA Rules not processed for user `225c73a50e9d46218d695dbd4309aace`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:32.895600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:32.962717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1159/2326] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:09:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:09:32.974739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:32.976639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:33.037751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54caf59-4be0-4991-a8fe-b696abbaecaf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:33.043002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:33.043985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:33.044595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:33.045090 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:33.057741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:33.059807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993e3ca-5a61-474e-ae41-93b3e30e3476 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:33.070465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1168/2327] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:33.096324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:33.154624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfb045-f8ea-4843-9a91-035b1bd2a70c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:33.159777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:33.160626 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:33.160900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:33.161171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] PATH_INFO: `/v3/users/225c73a50e9d46218d695dbd4309aace` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:33.162375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225c73a50e9d46218d695dbd4309aace)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:33.164283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:33.333585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225c73a50e9d46218d695dbd4309aace'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:33.389286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225c73a50e9d46218d695dbd4309aace'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:33.403933 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225c73a50e9d46218d695dbd4309aace'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:33.405132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225c73a50e9d46218d695dbd4309aace'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:33.405965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225c73a50e9d46218d695dbd4309aace'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:33.419678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1160/2328] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:09:33 2022] DELETE /identity/v3/users/225c73a50e9d46218d695dbd4309aace => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:09:33.424485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:33.424949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:33.425230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:33.442829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:33.444047 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:33.513205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1169/2329] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:33.523917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:33.525332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:33.581741 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a8195-bca4-4fdd-90af-b89e71e21f81 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:33.585552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:33.586222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:33.586506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:33.586808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:33.597169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:33.598827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:33.609037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1161/2330] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:33.803503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:33.804915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:33.821344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22dfe8-3dcb-4c7d-9f43-6f7489026782 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:33.825673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:33.826594 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:33.826944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:33.827285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:33.830185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:33.896194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:33.897842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:33.908690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1170/2331] 10.222.0.26 () {60 vars in 1396 bytes} [Tue Aug 23 06:09:33 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:09:34.157295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:34.158927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:34.172545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326f8d9-bcfa-42db-8635-c39cf4c9074c service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:34.177239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:34.178477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:34.178477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:34.178693 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] PATH_INFO: `/v3/projects/3cc866dccfd249e5bad0aed36fd03130` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:34.179867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc866dccfd249e5bad0aed36fd03130)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:34.181888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:34.494927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc866dccfd249e5bad0aed36fd03130', 'request_id': 'req-8761c161-b6d6-4695-a634-7d776d9e3ac9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:34.524374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc866dccfd249e5bad0aed36fd03130', 'request_id': 'req-8761c161-b6d6-4695-a634-7d776d9e3ac9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:34.524374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc866dccfd249e5bad0aed36fd03130', 'request_id': 'req-8761c161-b6d6-4695-a634-7d776d9e3ac9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:35.023053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] The token cache is being invalidate because project 3cc866dccfd249e5bad0aed36fd03130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:09:35.023333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:35.023938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:09:35.025510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1162/2332] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:09:34 2022] DELETE /identity/v3/projects/3cc866dccfd249e5bad0aed36fd03130 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:09:38.044386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:38.045896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:38.101789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1ffc-53a3-4b13-b768-490f84525133 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:38.150357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:38.151026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:38.151304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:38.151606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:38.153353 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:38.221838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:38.223313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d0fa6-5b28-4d03-8f56-e5bd17f1c663 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:38.234393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1171/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:40.678080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:40.679523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:40.691206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c161-b6d6-4695-a634-7d776d9e3ac9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:40.694704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:40.695324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:40.695599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:40.695866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:40.697516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:40.757177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:40.758637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:40.767781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1163/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:09:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:09:52.277981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:52.278445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:52.278539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:52.295328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:09:52.296506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:52.357272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1172/2335] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:09:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:09:52.382448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:09:52.383903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:09:52.450236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb315-6c50-4192-ba1c-356ad1b1553d service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:09:52.455828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:09:52.456467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:09:52.456748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:09:52.457025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:09:52.464791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:09:52.466414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334b04d-e9ec-456a-b28c-cddc1079ae9e service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:09:52.474291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1164/2336] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:09:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:10:05.877365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:10:05.878833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:05.933184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76b998-1ce1-4353-931c-d6eff23f3475 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:10:05.936799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:10:05.937445 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:10:05.937746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:10:05.938021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:10:05.939765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:05.948971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:10:05.950427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:10:05.958210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1173/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:10:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:10:08.795548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:10:08.796659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:10:08.796761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:10:08.813124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] MFA Rules not processed for user `ceb7b426bbef4637890ee6e203aee9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:10:08.814340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:08.821120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1165/2338] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:10:15.298582 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:10:15.300064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:15.319183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc234d-65ee-4e1a-be2a-c4fb111a627d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:10:15.322856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:10:15.323511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:10:15.323794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:10:15.324068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:10:15.325876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:15.338719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:10:15.340344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:10:15.351669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1174/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:10:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:10:16.863355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:10:16.864771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:16.880421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e83c1-6c1b-4cd2-98ae-faf3784b9b4f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:10:16.885972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:10:16.886654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:10:16.886939 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:10:16.887220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:10:16.889041 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:16.947296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:10:16.948823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636276-03fc-4386-8e54-83f1dcaf24ed service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:10:16.957971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1166/2340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:10:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:10:47.246247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:10:47.258304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeb1d9-ea09-472e-a8f4-6969d6c50310 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:10:47.263939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:10:47.264776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:10:47.265331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:10:47.265857 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:10:47.268523 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:10:47.326146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:10:47.327742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:10:47.336581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1175/2341] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:04.124806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:04.125455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:04.125455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:04.142537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] MFA Rules not processed for user `d2bd1b793a33487b834c4684b7c31231`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:04.143925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:04.150803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1167/2342] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:04.675996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:04.677476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:04.688793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ef57-3059-4158-b138-5995be7129ce service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:04.692330 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:04.692958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:04.693237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:04.693732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:04.695533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:04.705319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:04.706780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789ce16-b41e-4dae-9a62-784a7d37a92b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:04.714505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1176/2343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:05.101564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:05.103206 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:05.170621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932043b-df65-4541-b583-e5dd90e71913 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:05.175452 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:05.176096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:05.176372 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:05.176642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:05.178432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:05.189956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:05.191530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:05.201503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1168/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:11.819616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:11.820103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:11.820206 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:11.837175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] MFA Rules not processed for user `45f516e419574132b8760971af6146c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:11.838399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:11.891789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1177/2345] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:12.192367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:12.201952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee757f8-d203-4b90-a9c3-e9abd9ba0c14 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:12.205665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:12.206297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:12.206573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:12.206843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:12.208571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:12.218896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:12.220309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:12.228210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1169/2346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:16.156075 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:16.170890 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d58f-d83d-401f-961d-d0f90e3ac943 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:16.176347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:16.177028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:16.177310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:16.177621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:16.179654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:16.191946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:16.193764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:16.204745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1178/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:28.477719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:28.493067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29d6a4-7bb1-4ff8-aa97-5b19e16fc963 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:28.505997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:28.506663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:28.506944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:28.507223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:28.509125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:28.521968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:28.523619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:28.535559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1170/2348] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:34.370407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:34.379379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f21b4-6310-4e4e-9fb2-9c264a81a4cd service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:34.383023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:34.383514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:34.383792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:34.384064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:34.386482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:34.447114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:34.449136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:34.458734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1179/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:37.870294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:37.871800 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:37.885838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bd835-42b5-4e9a-803d-890cc1f1183c service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:37.891017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:37.891682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:37.892035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:37.892378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:37.894221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:37.906113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:37.907763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:37.921517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1171/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:38.108367 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:38.109948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:38.123935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77446c3e-eabe-43c1-a30b-477bef57c989 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:38.128552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:38.129681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:38.129965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:38.130241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] PATH_INFO: `/v3/users/ceb7b426bbef4637890ee6e203aee9fc` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:38.131429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb7b426bbef4637890ee6e203aee9fc)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:38.133383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:38.320531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb7b426bbef4637890ee6e203aee9fc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.410775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb7b426bbef4637890ee6e203aee9fc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.422579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb7b426bbef4637890ee6e203aee9fc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.423189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb7b426bbef4637890ee6e203aee9fc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.429650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-85750287-ead4-483d-8d6a-4a298b3b1df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb7b426bbef4637890ee6e203aee9fc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.435463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1180/2351] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:38 2022] DELETE /identity/v3/users/ceb7b426bbef4637890ee6e203aee9fc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:38.669458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:38.680672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbfb70-6d49-4dac-bc9a-69968800c2f8 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:38.742824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:38.743684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:38.743964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:38.744794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] PATH_INFO: `/v3/projects/41de49d1e830476fa45c59ed69f8b7c2` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:38.745981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41de49d1e830476fa45c59ed69f8b7c2)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:38.747890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:38.848323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41de49d1e830476fa45c59ed69f8b7c2', 'request_id': 'req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.854646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41de49d1e830476fa45c59ed69f8b7c2', 'request_id': 'req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.859891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41de49d1e830476fa45c59ed69f8b7c2', 'request_id': 'req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.946672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] The token cache is being invalidate because project 41de49d1e830476fa45c59ed69f8b7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:38.947350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.948235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8bb15a0b-fb69-4489-ab10-bfb9bd180ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:38.949919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1172/2352] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:38 2022] DELETE /identity/v3/projects/41de49d1e830476fa45c59ed69f8b7c2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:38.960285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:38.960595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:38.960861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:38.978460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:38.980233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:39.036124 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1181/2353] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:39.044635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-949c-45b8-9324-48e346833586 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.044991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-949c-45b8-9324-48e346833586 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.045334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-949c-45b8-9324-48e346833586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.064000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a68e2293-949c-45b8-9324-48e346833586 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:39.065192 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a68e2293-949c-45b8-9324-48e346833586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:39.075406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1173/2354] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:39.079651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.089018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c4570-16cd-4e1e-9879-44c97078e99a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.093597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.094234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.094518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.094793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.095505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:11:39.095810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.097394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.109331 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1182/2355] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:11:39.113411 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e2293-949c-45b8-9324-48e346833586 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.123072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e2293-949c-45b8-9324-48e346833586 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.129828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.130469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.130756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.131032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.131717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.133640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.223027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1174/2356] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:39.227501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.237810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa621bc-da45-467a-83a7-f670b03feef1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.291588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.292244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.292521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.292790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.293507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.295498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.406213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1183/2357] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:39.410271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.421013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714eb38-00a4-41e3-9ebe-5b1dc282229d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.425602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.426240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.426521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.426794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.427506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.429096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.438807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1175/2358] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:39.442673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.452368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6449-b226-45dd-bde5-7a2f9bc64dfb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.456973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.457647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.457929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.458203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.458917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.460508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcc804-287a-4ad3-86f1-0268361809e0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.470640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1184/2359] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:39.474580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.484894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4017a4e-4faa-41e2-9bd1-5f766b630b7f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.489318 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.490204 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.490480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.490750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] PATH_INFO: `/v3/projects/d8a7d2cd603f4e04b1296670909a33dc/users/bc420611f6a047a5ab3e64dfc640ade9/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.504431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a7d2cd603f4e04b1296670909a33dc, user_id=bc420611f6a047a5ab3e64dfc640ade9, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.507132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.627974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1176/2360] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:39 2022] PUT /identity/v3/projects/d8a7d2cd603f4e04b1296670909a33dc/users/bc420611f6a047a5ab3e64dfc640ade9/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:39.638586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.638861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.639134 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.665163 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] MFA Rules not processed for user `bc420611f6a047a5ab3e64dfc640ade9`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:39.667037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:39.731240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1185/2361] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:39.735791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.795617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875d10-df18-466e-88aa-aac8d0782003 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.800343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.800989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.801295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.801600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.802284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.804184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:39.897401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1177/2362] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:39.902155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:39.912592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a353953-66bb-4a52-b2d5-60691cc5af94 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:39.966443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:39.967102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:39.967382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:39.967656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:39.968336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:39.970368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.084917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1186/2363] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:39 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:11:40.089389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.099671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aac709-a803-4b16-a282-a7efdcac323e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.104500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.105144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.105428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.105740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.106463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.108061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.118574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1178/2364] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:40.123004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.132859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b330e7-8302-4f2e-a9a4-1bb2ab35992e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.138132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.138997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.139279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.139553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] PATH_INFO: `/v3/projects/e25186233c384917aafac28de185ab5d/users/9d0e7fd429f74ab28a8898d30d3d7ac6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.154118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25186233c384917aafac28de185ab5d, user_id=9d0e7fd429f74ab28a8898d30d3d7ac6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.156785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.227730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1187/2365] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:40 2022] PUT /identity/v3/projects/e25186233c384917aafac28de185ab5d/users/9d0e7fd429f74ab28a8898d30d3d7ac6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:40.231897 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.242634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7e98-3cdf-43ef-a403-8537ad2b8e34 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.299117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.299783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.300067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.300345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.301074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.302714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e477d-2af2-4598-bd80-f231b0c99283 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.312689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1179/2366] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:40.316850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.327731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b053e-7426-4547-a8bc-edf1c2bc2882 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.332342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.333215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.333531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.333813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] PATH_INFO: `/v3/projects/e25186233c384917aafac28de185ab5d/users/9d0e7fd429f74ab28a8898d30d3d7ac6/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.335836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25186233c384917aafac28de185ab5d, user_id=9d0e7fd429f74ab28a8898d30d3d7ac6, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.338507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.348597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1188/2367] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:40 2022] PUT /identity/v3/projects/e25186233c384917aafac28de185ab5d/users/9d0e7fd429f74ab28a8898d30d3d7ac6/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:40.360409 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.360699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.360979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.387999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] MFA Rules not processed for user `9d0e7fd429f74ab28a8898d30d3d7ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:40.389202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:40.453692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1180/2368] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:11:40.464363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.466104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:40.526839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfcaa4-287d-4b8e-b111-f29d88d3d9db admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.530440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.531066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.531344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.531612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.540322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.542305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c8c7b-2987-4647-b2ad-43f4dc8556bc service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.551382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1189/2369] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:40.682705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:40.741490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc21b78-96d8-48d9-a59f-988ff2d7c1f0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:40.746840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:40.747738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:40.748021 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:40.748297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] PATH_INFO: `/v3/users/bc420611f6a047a5ab3e64dfc640ade9` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:40.749532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc420611f6a047a5ab3e64dfc640ade9)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:40.751506 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:40.948821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc420611f6a047a5ab3e64dfc640ade9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.015975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc420611f6a047a5ab3e64dfc640ade9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.028165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc420611f6a047a5ab3e64dfc640ade9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.028801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc420611f6a047a5ab3e64dfc640ade9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.029400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc420611f6a047a5ab3e64dfc640ade9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.041989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1181/2370] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:40 2022] DELETE /identity/v3/users/bc420611f6a047a5ab3e64dfc640ade9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:41.046593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:41.046886 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:41.047168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:41.063836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:41.065046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:41.121244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1190/2371] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:41.130997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:41.132384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:41.187890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786ab00-c720-4560-a24a-e13b87c5ec84 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:41.191533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:41.192560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:41.192849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:41.193125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:41.202420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:41.203868 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:41.213779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1182/2372] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:41.605812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:41.607276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:41.619702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec768000-4df3-4271-8b3f-5364249d41fe None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:41.624645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:41.625531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:41.625809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:41.626121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] PATH_INFO: `/v3/projects/d8a7d2cd603f4e04b1296670909a33dc` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:41.627304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a7d2cd603f4e04b1296670909a33dc)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:41.629285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:41.763556 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a7d2cd603f4e04b1296670909a33dc', 'request_id': 'req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.769562 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a7d2cd603f4e04b1296670909a33dc', 'request_id': 'req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.774876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a7d2cd603f4e04b1296670909a33dc', 'request_id': 'req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.855324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] The token cache is being invalidate because project d8a7d2cd603f4e04b1296670909a33dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:41.855605 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.856207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:41.857764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1191/2373] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:41 2022] DELETE /identity/v3/projects/d8a7d2cd603f4e04b1296670909a33dc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:41.861909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:41.872018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7b3a6-ad48-4966-9927-0f580f58d904 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:41.924926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:41.925833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:41.926114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:41.926389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] PATH_INFO: `/v3/users/9d0e7fd429f74ab28a8898d30d3d7ac6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:41.927548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0e7fd429f74ab28a8898d30d3d7ac6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:41.929473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:42.126976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0e7fd429f74ab28a8898d30d3d7ac6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:42.176271 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0e7fd429f74ab28a8898d30d3d7ac6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:42.188489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0e7fd429f74ab28a8898d30d3d7ac6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:42.189109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0e7fd429f74ab28a8898d30d3d7ac6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:42.189743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3668eaf5-bcef-498f-8df2-a0a8195d0ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0e7fd429f74ab28a8898d30d3d7ac6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:42.201320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1183/2374] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:41 2022] DELETE /identity/v3/users/9d0e7fd429f74ab28a8898d30d3d7ac6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:42.942246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:42.943720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:42.958528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64fdf-4d0d-42f4-b4b2-b607692a85ac admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.017126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.018013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.018293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.018563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] PATH_INFO: `/v3/projects/e25186233c384917aafac28de185ab5d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.019746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25186233c384917aafac28de185ab5d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.021677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.129893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25186233c384917aafac28de185ab5d', 'request_id': 'req-3d0fcdc9-054b-4d81-9be7-ab682dc77506'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:43.136007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25186233c384917aafac28de185ab5d', 'request_id': 'req-3d0fcdc9-054b-4d81-9be7-ab682dc77506'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:43.141548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25186233c384917aafac28de185ab5d', 'request_id': 'req-3d0fcdc9-054b-4d81-9be7-ab682dc77506'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:43.220641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] The token cache is being invalidate because project e25186233c384917aafac28de185ab5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:43.220946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:43.221575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d0fcdc9-054b-4d81-9be7-ab682dc77506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:43.223204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1192/2375] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:42 2022] DELETE /identity/v3/projects/e25186233c384917aafac28de185ab5d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:43.228950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.231443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.231443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.247182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:43.248379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:43.305277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1184/2376] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:43.313093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.313378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.313695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.331879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:43.333109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:43.341466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1193/2377] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:43.345809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.356387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b6536-30c7-4a35-9f61-ad397afb12d5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.360940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.361622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.361909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.362211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.362940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:11:43.363246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.364850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.375979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1185/2378] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:11:43.380274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.389453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69f7f-5228-4013-8ea2-21d60dfb36c1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.394048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.394686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.394969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.395244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.395925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.397965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.534497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1194/2379] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:43 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:43.538791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.548745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad6999-a145-42ab-b270-68dd37adafad admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.604472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.609402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.609402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.609402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.609402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.609402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.725039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1186/2380] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:43 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:43.729447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.739421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba38d-a52d-4450-8240-93e9a69c2b8e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.743931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.744570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.744844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.745116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.745885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.747461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.757451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1195/2381] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:43.764417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.774279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449935a6-d5b5-4d29-909c-cac686e9b507 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.779607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.780250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.780532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.780866 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.781653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.783246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e662-4eaa-4648-b977-ba57d25f62b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.793116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1187/2382] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:11:43.796772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:43.806576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eda08b-ecf4-4615-9163-f0bf41c02b69 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:43.811071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:43.811924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.812236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.812488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] PATH_INFO: `/v3/projects/9801cb1f29ed44018d3f6ebf030727bb/users/e6e537b6f38743f8957086ce3e80c26c/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.826861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9801cb1f29ed44018d3f6ebf030727bb, user_id=e6e537b6f38743f8957086ce3e80c26c, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:43.829508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:43.942364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1196/2383] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:43 2022] PUT /identity/v3/projects/9801cb1f29ed44018d3f6ebf030727bb/users/e6e537b6f38743f8957086ce3e80c26c/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:43.953323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:43.953650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:43.953930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:43.980028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] MFA Rules not processed for user `e6e537b6f38743f8957086ce3e80c26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:43.981235 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:44.043489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1188/2384] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:44.047601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.106585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fc42-8bc9-47d9-9e48-8a1ec981b18e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.111221 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.111869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.112148 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.112421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.113110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.115051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.235251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1197/2385] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:44 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:44.239031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.250597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f01c3-d065-4d66-b2aa-3e39362d1e92 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.304860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.305473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.305750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.306023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.307363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.309268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.423234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1189/2386] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:44 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:44.427137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.438228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fde413-c685-4043-adc4-21fbeeed9a93 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.442923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.443600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.443878 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.444151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.444869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.446493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.457977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1198/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:44.462259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.472321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbfa8-eff9-4e06-9d2b-f4756d4e9482 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.477240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.478660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.478946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.479220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] PATH_INFO: `/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1/users/0a823fac17a848c6b3054685496224ad/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.493690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b931de0cf144b57ac2a844bb5a4bfe1, user_id=0a823fac17a848c6b3054685496224ad, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.496913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.633832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1190/2388] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:44 2022] PUT /identity/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1/users/0a823fac17a848c6b3054685496224ad/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:11:44.637790 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.647743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5f417-1e52-46ac-92d1-841af9c79590 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.702548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.703237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.703948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.703948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.704577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.706225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e4352-f77e-47de-869e-61abb3436f52 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.716383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1199/2389] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:44.720392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.731722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cba5-020c-43e5-b442-dfa3f75642d4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.736444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.737464 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.737747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.738022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] PATH_INFO: `/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1/users/0a823fac17a848c6b3054685496224ad/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.740042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b931de0cf144b57ac2a844bb5a4bfe1, user_id=0a823fac17a848c6b3054685496224ad, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.742896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.754279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1191/2390] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:44 2022] PUT /identity/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1/users/0a823fac17a848c6b3054685496224ad/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:44.765416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.765742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.766027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.792628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] MFA Rules not processed for user `0a823fac17a848c6b3054685496224ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:44.793897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:44.861850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1200/2391] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:44.873990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:44.875668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:44.930988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bc-ee9b-40e2-9b0e-73a56790958d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:44.935226 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:44.935853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:44.936132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:44.936407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:44.945261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:44.946723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:44.956078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1192/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:45.178836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:45.188565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e883ac-c301-4719-9c10-a91065069ec2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:45.192119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:45.192745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:45.193020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:45.193292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:45.249760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:45.251222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa64c-c6d3-4882-95e7-0afaa0234c53 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:45.283085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1201/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:11:48.944634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:49.004093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe412ab-bd08-461e-bf3e-2fed68f9a4de service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:49.008578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:49.009427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:49.009749 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:49.010029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] PATH_INFO: `/v3/users/e6e537b6f38743f8957086ce3e80c26c` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:49.011190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e537b6f38743f8957086ce3e80c26c)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:49.013338 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:49.212182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e537b6f38743f8957086ce3e80c26c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:49.284619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e537b6f38743f8957086ce3e80c26c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:49.297670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e537b6f38743f8957086ce3e80c26c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:49.298400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e537b6f38743f8957086ce3e80c26c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:49.299000 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e537b6f38743f8957086ce3e80c26c'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:49.311806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1193/2394] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:48 2022] DELETE /identity/v3/users/e6e537b6f38743f8957086ce3e80c26c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:11:49.316502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f55a6-78af-4d5f-a99a-f8c0e774dc4b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:49.316958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f55a6-78af-4d5f-a99a-f8c0e774dc4b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:49.317098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f55a6-78af-4d5f-a99a-f8c0e774dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:49.334516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-589f55a6-78af-4d5f-a99a-f8c0e774dc4b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:49.335738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-589f55a6-78af-4d5f-a99a-f8c0e774dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:49.395092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1202/2395] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:11:49.405173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:49.406620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:49.462228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8eac-b1da-4af9-b92e-ea60858ca74b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:49.466410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:49.467033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:49.467312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:49.467585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:49.476608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:49.478113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:49.488515 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1194/2396] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:49.647304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:49.647533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:49.647842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:49.666934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] MFA Rules not processed for user `a3b54fb538d04a2f8be2cb3c88f38d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:49.668159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:49.727222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1203/2397] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:49.899039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:49.900482 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:49.915995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410ed5-2794-42b4-9d22-fa6222d802b5 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:49.921027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:49.921991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:49.922339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:49.922734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] PATH_INFO: `/v3/projects/9801cb1f29ed44018d3f6ebf030727bb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:49.924080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9801cb1f29ed44018d3f6ebf030727bb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:49.927813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:50.061621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9801cb1f29ed44018d3f6ebf030727bb', 'request_id': 'req-8ed0f174-f896-44c5-abe0-a6efa67da7ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.067738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9801cb1f29ed44018d3f6ebf030727bb', 'request_id': 'req-8ed0f174-f896-44c5-abe0-a6efa67da7ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.073722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9801cb1f29ed44018d3f6ebf030727bb', 'request_id': 'req-8ed0f174-f896-44c5-abe0-a6efa67da7ae'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.196996 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] The token cache is being invalidate because project 9801cb1f29ed44018d3f6ebf030727bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:50.197209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.198550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.200170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1195/2398] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:49 2022] DELETE /identity/v3/projects/9801cb1f29ed44018d3f6ebf030727bb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:50.204279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:50.216170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eef16-90b9-47ec-ba79-4af245ac073c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:50.273972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:50.274846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:50.275127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:50.275404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] PATH_INFO: `/v3/users/0a823fac17a848c6b3054685496224ad` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:50.276602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a823fac17a848c6b3054685496224ad)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:50.278572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:50.516723 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a823fac17a848c6b3054685496224ad'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.605230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a823fac17a848c6b3054685496224ad'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.617749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a823fac17a848c6b3054685496224ad'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.618406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a823fac17a848c6b3054685496224ad'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.625824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9bfb66ba-f16a-424f-89e1-ba53312011b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a823fac17a848c6b3054685496224ad'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:50.631565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1204/2399] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:50 2022] DELETE /identity/v3/users/0a823fac17a848c6b3054685496224ad => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:51.058308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.059730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:51.072762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0f174-f896-44c5-abe0-a6efa67da7ae admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.129129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.130046 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.130327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.130598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] PATH_INFO: `/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.131830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b931de0cf144b57ac2a844bb5a4bfe1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.133759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.249408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b931de0cf144b57ac2a844bb5a4bfe1', 'request_id': 'req-14db1a94-f35d-4f73-820b-5d80fd3210c0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:51.255302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b931de0cf144b57ac2a844bb5a4bfe1', 'request_id': 'req-14db1a94-f35d-4f73-820b-5d80fd3210c0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:51.260522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b931de0cf144b57ac2a844bb5a4bfe1', 'request_id': 'req-14db1a94-f35d-4f73-820b-5d80fd3210c0'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:51.357979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] The token cache is being invalidate because project 2b931de0cf144b57ac2a844bb5a4bfe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:51.358277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:51.359007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-14db1a94-f35d-4f73-820b-5d80fd3210c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:51.360699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1196/2400] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:51 2022] DELETE /identity/v3/projects/2b931de0cf144b57ac2a844bb5a4bfe1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:51.365703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.365998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.366279 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.383856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:51.385597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:51.443250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1205/2401] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:51.451719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.452007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.452285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.471988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:51.473175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:51.481288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1197/2402] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:51.485589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.495246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc320546-d707-4575-bf11-22be60b97b20 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.499903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.500494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.500779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.501058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.501812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:11:51.502123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.503720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.515830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1206/2403] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:11:51.520213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.529848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440aba-fcae-4b70-a6ff-d80cc9a6ae65 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.534576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.535216 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.535494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.535764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.536494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.538438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.650364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1198/2404] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:51.655022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.665067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee8ac-61f3-45f3-b02b-978197600ca3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.721397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.722154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.722437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.722732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.723425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.725667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.843691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1207/2405] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:51 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:11:51.847721 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.858083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee779-d813-4d51-82f4-85f4dc8831eb admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.862531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.863168 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.863443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.863714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.864426 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.866060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.877542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1199/2406] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:51.892965 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.903313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc239-fc85-46f4-85f8-23fd385defe3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.908165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.908869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.909159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.909454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.910191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.911819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757c8d-aaee-469b-812a-9943fc4f8e81 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:51.922252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1208/2407] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:51.926244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:51.936507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6cb6d-d72c-4773-a11d-418ac351ccc5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:51.941077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:51.941966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:51.942251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:51.942525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] PATH_INFO: `/v3/projects/3d576c7518d04497be1751794074c2e1/users/18e7df183e1a41d584c1182e1673a834/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:51.957208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d576c7518d04497be1751794074c2e1, user_id=18e7df183e1a41d584c1182e1673a834, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:51.959904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:52.118919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1200/2408] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:51 2022] PUT /identity/v3/projects/3d576c7518d04497be1751794074c2e1/users/18e7df183e1a41d584c1182e1673a834/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:52.129565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:52.129864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:52.130153 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:52.155800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] MFA Rules not processed for user `18e7df183e1a41d584c1182e1673a834`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:52.157071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:52.218762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1209/2409] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:52.230173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:52.231856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:52.286732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b6de-3e73-42a4-99bc-a180a28a091b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:52.290512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:52.291153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:52.291436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:52.291712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:52.300953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:52.302450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0657b-ffd7-4145-aede-9cc21d12ed03 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:52.312137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1201/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:56.710286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:56.775736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9e9f3-e6ea-453d-bbe6-5b927897ce30 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:56.780602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:56.781495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:56.781781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:56.782051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] PATH_INFO: `/v3/users/18e7df183e1a41d584c1182e1673a834` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:56.783235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e7df183e1a41d584c1182e1673a834)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:56.785154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:57.023609 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e7df183e1a41d584c1182e1673a834'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:57.125291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e7df183e1a41d584c1182e1673a834'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:57.138916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e7df183e1a41d584c1182e1673a834'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:57.139642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e7df183e1a41d584c1182e1673a834'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:57.147518 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e7df183e1a41d584c1182e1673a834'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:57.153831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1210/2411] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:11:56 2022] DELETE /identity/v3/users/18e7df183e1a41d584c1182e1673a834 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:57.158425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:57.159320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:57.159691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:57.176605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:57.177986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:57.241175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1202/2412] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:57.254448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:57.255999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:57.452508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021be3-01de-4ce3-82b3-da3e19b1c8bb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:57.456323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:57.457094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:57.457380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:57.457803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:57.470725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:57.472191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8d18f-5a2e-472b-8271-9168368966c6 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:57.487431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1211/2413] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:11:57.995902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:57.996709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:58.008243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162fb14-7804-40e9-b7d1-a36df9bb8399 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.013380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.014270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.014551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.014825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] PATH_INFO: `/v3/projects/3d576c7518d04497be1751794074c2e1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.016012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d576c7518d04497be1751794074c2e1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.017962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.141564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d576c7518d04497be1751794074c2e1', 'request_id': 'req-92f7ca2d-d00a-456c-a04c-5159c8cbba09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:58.147878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d576c7518d04497be1751794074c2e1', 'request_id': 'req-92f7ca2d-d00a-456c-a04c-5159c8cbba09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:58.153778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d576c7518d04497be1751794074c2e1', 'request_id': 'req-92f7ca2d-d00a-456c-a04c-5159c8cbba09'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:58.283687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] The token cache is being invalidate because project 3d576c7518d04497be1751794074c2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:11:58.284295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:58.284596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-92f7ca2d-d00a-456c-a04c-5159c8cbba09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:11:58.286423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1203/2414] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:11:57 2022] DELETE /identity/v3/projects/3d576c7518d04497be1751794074c2e1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:58.292865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.293301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.293481 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.311734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:58.312858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:58.373373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1212/2415] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:58.381600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183406-90af-4bc0-9e06-383fd8df5d07 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.381814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183406-90af-4bc0-9e06-383fd8df5d07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.381959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183406-90af-4bc0-9e06-383fd8df5d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.403643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f9183406-90af-4bc0-9e06-383fd8df5d07 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:58.404888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9183406-90af-4bc0-9e06-383fd8df5d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:58.417845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1204/2416] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:58.418724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.428739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07028b3-d27f-4ca8-8a4c-a292223b5ad9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.433478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.433978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.434255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.435097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.435757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.436042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.436344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.437096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:11:58.437424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.439107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.451983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1213/2417] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:11:58.453231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] MFA Rules not processed for user `93edd5588db648ae9d5be8f20f60d6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:58.454646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:58.456344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.466168 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263df7ef-fea8-490f-a9a8-388eceb88a9c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.470847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.471478 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.471761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.472038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.472734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.474644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.515308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1205/2418] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:11:58.559431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1214/2419] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:11:58.563708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.575502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d611e-9c06-4c6a-ae6c-3bcac86cfd41 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.637023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.637768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.638006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.638280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.638978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.640949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.759379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1206/2420] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:11:58.764021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.784419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f39b79-c530-4036-9e86-89a675a7aaa0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.793081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.793789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.794072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.794344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.795070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.796663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.810252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1215/2421] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:11:58.811995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.827190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed08c-bdc9-482c-b80e-ceff57785fdc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.831925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.832587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.832873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.833256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.833924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.835618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037eec-6f9e-4ca8-88da-af2863b32bf7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.845814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1207/2422] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:11:58.849932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:58.861187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9386-249f-455d-8b53-16e90b381fdd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:58.865720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:58.866584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.866861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.870448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] PATH_INFO: `/v3/projects/a91efb5de046414c8f0c820777edaee0/users/b266da5a2b474c8d9cfc3808fa9cc804/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:58.881874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91efb5de046414c8f0c820777edaee0, user_id=b266da5a2b474c8d9cfc3808fa9cc804, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:58.884621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:58.984166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1216/2423] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:11:58 2022] PUT /identity/v3/projects/a91efb5de046414c8f0c820777edaee0/users/b266da5a2b474c8d9cfc3808fa9cc804/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:11:58.995571 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:58.995865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:58.996157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:59.024286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] MFA Rules not processed for user `b266da5a2b474c8d9cfc3808fa9cc804`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:11:59.025588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:59.094563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1208/2424] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:11:59.102198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:11:59.104429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:11:59.161730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cd1ba-d807-4fc6-9e82-e76c23108c6d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:11:59.165297 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:11:59.166645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:11:59.166924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:11:59.167194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:11:59.175939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:11:59.178237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93024b62-8b56-41a0-9ae5-9d69fb28a94b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:11:59.187595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1217/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:11:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:12:10.781803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:10.841671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672ad9a-563e-470c-9d2f-144832fe5e5d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:10.846132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:10.846993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:10.847273 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:10.847548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] PATH_INFO: `/v3/users/b266da5a2b474c8d9cfc3808fa9cc804` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:10.848725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b266da5a2b474c8d9cfc3808fa9cc804)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:10.850948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:11.157580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b266da5a2b474c8d9cfc3808fa9cc804'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:11.236067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b266da5a2b474c8d9cfc3808fa9cc804'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:11.248286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b266da5a2b474c8d9cfc3808fa9cc804'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:11.251279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b266da5a2b474c8d9cfc3808fa9cc804'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:11.251279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b266da5a2b474c8d9cfc3808fa9cc804'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:11.261499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1209/2426] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:12:10 2022] DELETE /identity/v3/users/b266da5a2b474c8d9cfc3808fa9cc804 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:12:11.265955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:11.266449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:11.266547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:11.283788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:11.284952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:11.340845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1218/2427] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:11.350755 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:11.352646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:11.408308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cc386-4488-4f01-9ab8-cad89e45a834 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:11.411911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:11.412547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:11.412830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:11.413108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:11.422569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:11.424012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058d6f2-6a00-455b-afae-0498714422e5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:11.433816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1210/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:12:11.810571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:11.812333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:11.826126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24cba8-114a-410a-92ff-a2baae33fc72 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:11.831657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:11.832511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:11.832785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:11.833054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] PATH_INFO: `/v3/projects/a91efb5de046414c8f0c820777edaee0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:11.834257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91efb5de046414c8f0c820777edaee0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:11.836202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.042451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91efb5de046414c8f0c820777edaee0', 'request_id': 'req-8320efd7-d84f-440c-b721-4017515d8c72'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:12.048654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91efb5de046414c8f0c820777edaee0', 'request_id': 'req-8320efd7-d84f-440c-b721-4017515d8c72'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:12.053986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91efb5de046414c8f0c820777edaee0', 'request_id': 'req-8320efd7-d84f-440c-b721-4017515d8c72'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:12.151572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] The token cache is being invalidate because project a91efb5de046414c8f0c820777edaee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:12:12.151858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:12.152476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8320efd7-d84f-440c-b721-4017515d8c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:12:12.154029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1219/2429] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:12:11 2022] DELETE /identity/v3/projects/a91efb5de046414c8f0c820777edaee0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:12:12.158959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.159412 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.159511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.176795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:12.178020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:12.236242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1211/2430] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:12.245496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.245788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.246063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.264095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:12.265267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:12.272896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1220/2431] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:12.277462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.286927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a39fa-f385-4397-bbe4-e382cbe92633 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.291491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685893-3475-44ec-9602-054aadface26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.292136 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685893-3475-44ec-9602-054aadface26 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.292422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685893-3475-44ec-9602-054aadface26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.292701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11685893-3475-44ec-9602-054aadface26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.293424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685893-3475-44ec-9602-054aadface26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:12:12.293760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685893-3475-44ec-9602-054aadface26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.295381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11685893-3475-44ec-9602-054aadface26 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.306474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1212/2432] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:12:12.310580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.319409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febb7f6-6aac-494b-a55d-27c739f84739 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.324466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.325113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.325391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.325697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.326365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.328227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.454468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1221/2433] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:12:12 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:12:12.458592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685893-3475-44ec-9602-054aadface26 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.468927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11685893-3475-44ec-9602-054aadface26 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.522638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.523296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.523577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.524345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.525033 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.526985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.631666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1213/2434] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:12:12 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:12:12.635738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.645829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d5c1-8a68-4079-860d-360f5b473b74 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.651041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.651682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.651966 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.652244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.652992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.654667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.665412 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1222/2435] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:12:12.669073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.678864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c0cc-6aff-4f85-b88f-52bbaa0521f3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.683465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.684138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.684425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.684702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.685427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.687038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c7a22-e417-4344-add3-bd8cbbad9f3f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.696740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1214/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:12:12.700533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.709961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7044-2ec4-442e-84ea-5e6dbf0569db admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.715076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.715926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.716209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.716492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] PATH_INFO: `/v3/projects/dbc74906c6ae4a76b628ff3fa8cda00e/users/c8a705b8ac9f40bfb35110ee2f61ac17/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.732020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc74906c6ae4a76b628ff3fa8cda00e, user_id=c8a705b8ac9f40bfb35110ee2f61ac17, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.734684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.803789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1223/2437] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:12:12 2022] PUT /identity/v3/projects/dbc74906c6ae4a76b628ff3fa8cda00e/users/c8a705b8ac9f40bfb35110ee2f61ac17/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:12:12.809065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4271-65ee-4a62-b143-39c068513c47 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.809536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4271-65ee-4a62-b143-39c068513c47 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.809892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4271-65ee-4a62-b143-39c068513c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.832589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ad3e4271-65ee-4a62-b143-39c068513c47 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:12.833514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ad3e4271-65ee-4a62-b143-39c068513c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:12.892366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1215/2438] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:12.902542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:12.904340 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:12.957772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a1ba-914e-4a30-8fc6-5ffeb846e4e5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:12.961988 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:12.962621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:12.962901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:12.963176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:12.971858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:12.973283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:12.982675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1224/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:12:18.484632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:18.486030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:18.486349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:18.519239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] MFA Rules not processed for user `c8a705b8ac9f40bfb35110ee2f61ac17`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:18.520487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:18.599079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1216/2440] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:18.604020 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:18.613887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bd73-2271-4efc-83a5-48eafea5bd21 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:18.618977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:18.619627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:18.620525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:18.620810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:18.621548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:18.623458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:18.781928 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1225/2441] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:12:18 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:12:18.786158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:18.810583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fd6e2-bb79-41d3-94b4-d1021d7a6f39 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:18.890241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:18.891964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:18.892526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:18.893265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:18.893597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:18.893870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:18.894572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:18.896512 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:18.975327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c738f5-36ad-410a-82c8-7cf0bca13207 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:18.981227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:18.981918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:18.982203 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:18.982484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:18.984337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:18.996986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:18.998801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:19.009327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1226/2442] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:12:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:12:19.018172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1217/2443] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:12:18 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:12:19.019870 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:19.034372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb61e-00cd-461a-8896-512d4d4cf0b7 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:19.039633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:19.040289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:19.040570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:19.040845 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:19.041651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:19.046397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:19.054157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1227/2444] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:12:19.059169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:19.069658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4314-5b7b-4ae8-ab7d-9ee5e0265d48 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:19.078386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:19.079294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:19.079575 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:19.079875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] PATH_INFO: `/v3/projects/12370ad0ad8f4c5eafa452545c053d78/users/d465e9cc8a3d4aada169d89523e7022d/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:19.096432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12370ad0ad8f4c5eafa452545c053d78, user_id=d465e9cc8a3d4aada169d89523e7022d, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:19.103926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:19.180679 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1218/2445] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:12:19 2022] PUT /identity/v3/projects/12370ad0ad8f4c5eafa452545c053d78/users/d465e9cc8a3d4aada169d89523e7022d/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:12:19.190200 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:19.194684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65e075-2815-4d62-8d5a-3a1e5f9bf678 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:19.249711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:19.250370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:19.250647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:19.250918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:19.251635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:19.253208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830dfc9-d028-4cc9-8cbd-2f3fb7e7e743 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:19.262860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1228/2446] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:12:19.266929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:19.277527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82af72-be82-4e4e-80ff-2c9c6544f10f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:19.282048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:19.282911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:19.283196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:19.283469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] PATH_INFO: `/v3/projects/12370ad0ad8f4c5eafa452545c053d78/users/d465e9cc8a3d4aada169d89523e7022d/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:19.285387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12370ad0ad8f4c5eafa452545c053d78, user_id=d465e9cc8a3d4aada169d89523e7022d, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:19.288227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:19.298978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1219/2447] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:12:19 2022] PUT /identity/v3/projects/12370ad0ad8f4c5eafa452545c053d78/users/d465e9cc8a3d4aada169d89523e7022d/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:12:25.313948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beef73-ad78-4a9e-a097-2d2e0dca54d8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:25.314401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beef73-ad78-4a9e-a097-2d2e0dca54d8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:25.314503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beef73-ad78-4a9e-a097-2d2e0dca54d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:25.345948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-11beef73-ad78-4a9e-a097-2d2e0dca54d8 None None] MFA Rules not processed for user `d465e9cc8a3d4aada169d89523e7022d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:25.347462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11beef73-ad78-4a9e-a097-2d2e0dca54d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:25.423550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1229/2448] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:12:25.438113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:12:25.439932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:25.514896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabaa3-8980-4680-b9b7-9ee9e913da41 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:12:25.520300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:12:25.520999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:25.521217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:25.521526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:25.578523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:12:25.580141 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ffef4-3301-475b-9948-3434ef67e381 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:12:25.589251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1220/2449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:12:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:12:28.222526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:12:28.223053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:12:28.223053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:12:28.242489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] MFA Rules not processed for user `c8a705b8ac9f40bfb35110ee2f61ac17`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:12:28.243762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:12:28.251235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1230/2450] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:13:10.688091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be8ed-7932-4963-95d7-109a4e563622 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:10.688699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be8ed-7932-4963-95d7-109a4e563622 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:10.688699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be8ed-7932-4963-95d7-109a4e563622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:10.706783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-852be8ed-7932-4963-95d7-109a4e563622 None None] MFA Rules not processed for user `d2bd1b793a33487b834c4684b7c31231`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:10.708090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-852be8ed-7932-4963-95d7-109a4e563622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:10.766675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1221/2451] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:13:13.498234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:13.500256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:13.558358 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d864-3bdf-47ae-a0f6-cab0a13788f4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:13.562547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:13.563199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:13.563489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:13.563756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:13.574304 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:13.576248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:13.593710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1231/2452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:13:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:13:17.356746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8c7-1d11-4676-b91d-1715a2492d65 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:17.357240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8c7-1d11-4676-b91d-1715a2492d65 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:17.357337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8c7-1d11-4676-b91d-1715a2492d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:17.374876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b81ce8c7-1d11-4676-b91d-1715a2492d65 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:17.376043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b81ce8c7-1d11-4676-b91d-1715a2492d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:17.430919 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1222/2453] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:13:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:17.570476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:17.572261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:17.639565 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37af7-e72f-47d7-8cc3-3c2338286e15 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:17.644650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:17.645293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:17.645622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:17.645903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:17.654308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:17.655880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a2ef8-db99-42c9-be31-6b7d7c5d750f service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:17.664097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1232/2454] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:13:34.388345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.388831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.389042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.390994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1223/2455] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:13:34.396818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd57f5-668e-4c3f-974d-429619ee45c4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.397341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd57f5-668e-4c3f-974d-429619ee45c4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.397341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd57f5-668e-4c3f-974d-429619ee45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.415882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-97fd57f5-668e-4c3f-974d-429619ee45c4 None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:34.417093 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-97fd57f5-668e-4c3f-974d-429619ee45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:34.426949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1233/2456] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:13:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:34.438578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:34.440439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:34.497220 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c43455-dfb2-4783-9bd0-a3168ae451e0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:34.500740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:34.501369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.501691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.501964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.516441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:34.516441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5ac97-70ef-4373-88c5-7632bbc4e4fa service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:34.524887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1224/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:13:34.728402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc1f9-69d4-4d98-9070-f9c74b26cb56 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.728769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc1f9-69d4-4d98-9070-f9c74b26cb56 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.729095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cc1f9-69d4-4d98-9070-f9c74b26cb56 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.731138 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1234/2458] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:13:34.736991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db763-c887-4eda-99e5-0f67ff9f1128 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.736991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db763-c887-4eda-99e5-0f67ff9f1128 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.737246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db763-c887-4eda-99e5-0f67ff9f1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.754659 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1f7db763-c887-4eda-99e5-0f67ff9f1128 None None] MFA Rules not processed for user `064fd80565d543dfaca680bebfbb7127`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:34.755846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1f7db763-c887-4eda-99e5-0f67ff9f1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:34.762241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1225/2459] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:13:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:34.774839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc1f9-69d4-4d98-9070-f9c74b26cb56 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:34.786339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cc1f9-69d4-4d98-9070-f9c74b26cb56 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:34.790684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:34.791315 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.791597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.791871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.799097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:34.800600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9dede-7989-4b2e-823f-a1ec3c7d3e24 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:34.808317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1235/2460] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:13:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:13:34.895956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b2cd-598a-48e7-9649-4412590813fb None None] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.896231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b2cd-598a-48e7-9649-4412590813fb None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.896510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b2cd-598a-48e7-9649-4412590813fb None None] PATH_INFO: `/` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.898381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1226/2461] 10.222.0.26 () {54 vars in 921 bytes} [Tue Aug 23 06:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 06:13:34.903525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36f4d1-4927-42ba-a3da-1740d2575a6a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.903812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36f4d1-4927-42ba-a3da-1740d2575a6a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.904091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36f4d1-4927-42ba-a3da-1740d2575a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.922348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ec36f4d1-4927-42ba-a3da-1740d2575a6a None None] MFA Rules not processed for user `18cdab9833c3477b9c95fb011e629bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:34.923544 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ec36f4d1-4927-42ba-a3da-1740d2575a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:34.933177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1236/2462] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Aug 23 06:13:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:34.944324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b2cd-598a-48e7-9649-4412590813fb None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:34.955615 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b2cd-598a-48e7-9649-4412590813fb None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:34.959202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:34.959825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:34.960105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:34.960380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:34.970074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:34.971500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:34.981767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1227/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:13:37.228860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735ba0-762c-4ba2-8eeb-b115aba1a081 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:37.229309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735ba0-762c-4ba2-8eeb-b115aba1a081 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:37.229403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735ba0-762c-4ba2-8eeb-b115aba1a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:37.252549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ee735ba0-762c-4ba2-8eeb-b115aba1a081 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:37.253785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ee735ba0-762c-4ba2-8eeb-b115aba1a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:37.260980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1237/2464] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:13:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:37.274702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:37.285824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6694d3-510e-4df3-a4a8-0bd25f87203b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:37.290946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:37.291720 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:37.292068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:37.292416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:37.300596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:37.302364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:37.310666 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1228/2465] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 06:13:58.608018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:58.608514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:58.608617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:58.627214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:13:58.628402 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:13:58.636027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1238/2466] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:13:58.648440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:13:58.658622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd346f-a8e8-4bec-b6ce-98db368ded7b service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:13:58.663562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:13:58.664179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:13:58.664456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:13:58.664735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:13:58.672394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:13:58.674543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:13:58.682381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1229/2467] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:14:19.520468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:19.529698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b3fb-7351-463a-bc8a-39fa1b2c4e24 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:19.533472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:19.534132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:19.534413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:19.534686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:19.536438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:19.597119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:19.598564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:19.607980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1239/2468] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:23.567583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:23.569583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:23.582985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab032ee9-6d31-4ff1-a8aa-6961ea6af3e8 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:23.588151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:23.589010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:23.589288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:23.589593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] PATH_INFO: `/v3/users/a3b54fb538d04a2f8be2cb3c88f38d7d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:23.602784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b54fb538d04a2f8be2cb3c88f38d7d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:23.604747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:23.817796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b54fb538d04a2f8be2cb3c88f38d7d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:23.912035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b54fb538d04a2f8be2cb3c88f38d7d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:23.924462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b54fb538d04a2f8be2cb3c88f38d7d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:23.925092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b54fb538d04a2f8be2cb3c88f38d7d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:23.925727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-077c9cd1-a274-42b2-8ede-75d13375b056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b54fb538d04a2f8be2cb3c88f38d7d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:23.938057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1230/2469] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:14:23 2022] DELETE /identity/v3/users/a3b54fb538d04a2f8be2cb3c88f38d7d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:24.206608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:24.216641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55857c-853e-4efe-8497-7c9c77511744 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:24.275231 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:24.276087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.276369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.276647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] PATH_INFO: `/v3/projects/8149140f47e447fd92f7101559b3f0d3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.293823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8149140f47e447fd92f7101559b3f0d3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:24.295783 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:24.454778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8149140f47e447fd92f7101559b3f0d3', 'request_id': 'req-18e7ca16-188f-4644-9f68-2562a2fd3dc6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:24.461572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8149140f47e447fd92f7101559b3f0d3', 'request_id': 'req-18e7ca16-188f-4644-9f68-2562a2fd3dc6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:24.467110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8149140f47e447fd92f7101559b3f0d3', 'request_id': 'req-18e7ca16-188f-4644-9f68-2562a2fd3dc6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:24.540058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] The token cache is being invalidate because project 8149140f47e447fd92f7101559b3f0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:14:24.540364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:24.541026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-18e7ca16-188f-4644-9f68-2562a2fd3dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:24.542618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1240/2470] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:14:24 2022] DELETE /identity/v3/projects/8149140f47e447fd92f7101559b3f0d3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:24.548405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.548405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.548405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.566418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:24.567607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:24.624224 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1231/2471] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:24.632363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.632678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.632953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.650931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:24.652118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:24.659939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1241/2472] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:24.664476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:24.673738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a96c-8a51-427b-8eea-9b16cc897f91 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:24.678247 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:24.678885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.679169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.679443 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.680164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:14:24.680467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:24.682104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:24.693134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1232/2473] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:14:24.697145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:24.706110 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394245af-8a69-4061-9b99-cb4bc605d1b9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:24.711300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:24.711919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.712194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.712462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.713131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:24.715108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:24.804521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1242/2474] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:14:24 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:24.808632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:24.818469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579581-b914-4a5a-8fca-dd0efba603a3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:24.873810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:24.874529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:24.874808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:24.875078 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:24.875842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:24.877791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:24.984558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1233/2475] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:14:24 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:24.988647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:24.999243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb1f9-f126-4a71-85c7-afabcb75be43 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:25.003825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:25.004491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:25.004769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:25.005041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:25.005791 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:25.007883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:25.017999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1243/2476] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:25.022572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:25.032237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fc80-b416-454a-ad8e-d7f64f1e39de admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:25.036812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:25.037531 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:25.037846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:25.038129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:25.038839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:25.040495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d83664-86c3-4866-bb5f-188694d10f5f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:25.050007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1234/2477] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:25.053863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:25.063358 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f30f0-d355-46dd-8c08-ae77967baab2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:25.067785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:25.069185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:25.069494 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:25.069779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] PATH_INFO: `/v3/projects/3bb3c43c9dd94a31b08a75ab4eeb7835/users/c3964681ffae4feb81e12ec998f230e5/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:25.083864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb3c43c9dd94a31b08a75ab4eeb7835, user_id=c3964681ffae4feb81e12ec998f230e5, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:25.087201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:25.218363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1244/2478] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:14:25 2022] PUT /identity/v3/projects/3bb3c43c9dd94a31b08a75ab4eeb7835/users/c3964681ffae4feb81e12ec998f230e5/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:25.228523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:25.228813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:25.229093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:25.255363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] MFA Rules not processed for user `c3964681ffae4feb81e12ec998f230e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:25.257100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:25.327448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1235/2479] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:25.339018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:25.340739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:25.397126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f893-4911-4dcb-b023-73e51bec948c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:25.400807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:25.401472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:25.401758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:25.402040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:25.410978 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:25.412449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:25.421195 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1245/2480] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:26.879562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:26.889657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99b26-d768-49bd-80f5-8afd3c70d7ba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:26.893286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:26.893954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:26.894239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:26.894511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:26.896245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:26.953995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:26.955505 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e385-d1fd-4d52-b5f2-c7f710a23447 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:26.964727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1236/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:32.986068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:32.995292 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818404-26b0-46c1-8e89-3d35f27fa9fb service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:32.998855 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:32.999553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:32.999843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:33.000147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:33.001949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:33.071438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:33.072903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:33.083751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1246/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:39.645337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:39.645862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:39.645862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:39.662787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] MFA Rules not processed for user `93edd5588db648ae9d5be8f20f60d6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:39.664240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:39.671191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1237/2483] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:39.706535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:39.715016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebcdf6-0ecc-483b-8d52-6229fc1f10de service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:39.718872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:39.719531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:39.719811 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:39.720086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:39.721926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:39.735156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:39.736570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c7b41-39e3-4af8-aad2-85270b42cb14 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:39.748362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1247/2484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:44.717006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:44.778284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f5c7-c2f4-4d1f-9572-d204b2e5853d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:44.783146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:44.784009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:44.784285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:44.784584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] PATH_INFO: `/v3/users/c3964681ffae4feb81e12ec998f230e5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:44.785801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3964681ffae4feb81e12ec998f230e5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:44.787771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:44.968705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3964681ffae4feb81e12ec998f230e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:45.066103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3964681ffae4feb81e12ec998f230e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:45.078918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3964681ffae4feb81e12ec998f230e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:45.079614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3964681ffae4feb81e12ec998f230e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:45.080217 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3964681ffae4feb81e12ec998f230e5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:45.092935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1238/2485] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:14:44 2022] DELETE /identity/v3/users/c3964681ffae4feb81e12ec998f230e5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:45.097489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:45.097983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:45.098099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:45.115648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:45.117099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:45.176091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1248/2486] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:45.186023 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:45.187414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:45.244008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e59f8-c2c1-4668-a02f-732911a6477b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:45.248296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:45.248949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:45.249357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:45.249685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:45.259272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:45.260724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15521a3c-f3df-40df-b472-b323de1eefa2 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:45.272143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1239/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:45.850932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:45.858248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:45.864521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05072a-5d62-4093-89b4-0342fab23e88 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:45.870316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:45.871415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:45.871703 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:45.872534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] PATH_INFO: `/v3/projects/3bb3c43c9dd94a31b08a75ab4eeb7835` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:45.874017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb3c43c9dd94a31b08a75ab4eeb7835)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:45.875990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:45.997576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb3c43c9dd94a31b08a75ab4eeb7835', 'request_id': 'req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:46.003841 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb3c43c9dd94a31b08a75ab4eeb7835', 'request_id': 'req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:46.009243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb3c43c9dd94a31b08a75ab4eeb7835', 'request_id': 'req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:46.088162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] The token cache is being invalidate because project 3bb3c43c9dd94a31b08a75ab4eeb7835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:14:46.088454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:46.089079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-948cc3cf-e0fb-4a6d-8fd6-9024a82523d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:14:46.090660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1249/2488] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:14:45 2022] DELETE /identity/v3/projects/3bb3c43c9dd94a31b08a75ab4eeb7835 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:46.096557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.096557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.096557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.113970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:46.115160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:46.173690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1240/2489] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:46.183008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.183505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.183611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.201713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:46.202901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:46.210641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1250/2490] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:14:46.214728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.224239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d21d-4cc3-406d-9c2f-344e6509755a None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.229517 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.230185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.230465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.230735 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.231486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:14:46.231793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.233401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.245670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1241/2491] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:14:46.249630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.258503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553a5f3-9928-4636-a11b-f37e697dc875 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.263108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.263737 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.264018 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.264291 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.264976 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.266896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.356103 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1251/2492] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:46.360261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.370930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6768-a2eb-48cd-9eb7-759ccc685f63 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.426228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.426930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.427215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.427522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.428228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.430214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.526063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1242/2493] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:46.530118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.540779 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbbbb2-24c9-47de-ae8b-bcc03dd6cb0e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.545484 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.546126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.546405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.546678 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.547395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.548970 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.559216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1252/2494] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:46.562930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.572593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c95b3-6a23-44ca-97bb-f978e00c1884 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.577073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.577747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.578029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.578304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.579012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.580618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687730d4-b213-42fb-9ace-50e5ee5a644c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.590653 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1243/2495] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:46.594579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.604776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f791a4-f2f0-463d-8ed2-0107c096ca62 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.609366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.610194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.610477 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.610748 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] PATH_INFO: `/v3/projects/e8e519e0ce1a48229ba51331b2ad43f0/users/699648b5e706432ea2a9a6d792119eb7/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.625742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e519e0ce1a48229ba51331b2ad43f0, user_id=699648b5e706432ea2a9a6d792119eb7, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.628362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:46.736766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1253/2496] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:14:46 2022] PUT /identity/v3/projects/e8e519e0ce1a48229ba51331b2ad43f0/users/699648b5e706432ea2a9a6d792119eb7/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:46.747592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.747884 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.748160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.775067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] MFA Rules not processed for user `699648b5e706432ea2a9a6d792119eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:46.776255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:46.840494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1244/2497] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:46.845096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:46.906361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb817c-388e-4401-9511-7dc241f8411e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:46.911174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:46.911827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:46.912106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:46.912375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:46.913063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:46.915027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.007106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1254/2498] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:14:46 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:47.011487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.021882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be919-fec3-410b-a597-57c7257cfc25 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.074609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.075257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.075541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.075813 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.076501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.078449 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.157796 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1245/2499] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:14:47 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:14:47.161860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.171931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a174-3268-4458-8d30-aed7c434b444 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.176714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.177360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.177668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.177943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.178654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.180829 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.191526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1255/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:47.196351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.206696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfd02-19cc-47c8-9da5-6fa7bac68faf admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.211343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.212221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.212504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.212779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] PATH_INFO: `/v3/projects/c861b82c385a48a491bdea10eff85201/users/1e61c229c8bf4dc2bc5948cbd2d79c46/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.227101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861b82c385a48a491bdea10eff85201, user_id=1e61c229c8bf4dc2bc5948cbd2d79c46, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.229799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.331290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1246/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:14:47 2022] PUT /identity/v3/projects/c861b82c385a48a491bdea10eff85201/users/1e61c229c8bf4dc2bc5948cbd2d79c46/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:47.335242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.345084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ecbe1-b0d0-46c4-a269-7756dd6ac4bd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.399690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.400354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.400636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.400910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.401683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.403268 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75730-77b2-41b1-9edb-c79a5354df86 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.412952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1256/2502] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:14:47.417036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.427364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861e42b-41a0-4f8b-be73-934bdee3e3d2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.432574 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.433494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.433781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.434057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] PATH_INFO: `/v3/projects/c861b82c385a48a491bdea10eff85201/users/1e61c229c8bf4dc2bc5948cbd2d79c46/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.436015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861b82c385a48a491bdea10eff85201, user_id=1e61c229c8bf4dc2bc5948cbd2d79c46, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.438797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.449651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1247/2503] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:14:47 2022] PUT /identity/v3/projects/c861b82c385a48a491bdea10eff85201/users/1e61c229c8bf4dc2bc5948cbd2d79c46/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:14:47.461003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.462729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.462729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.488115 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] MFA Rules not processed for user `1e61c229c8bf4dc2bc5948cbd2d79c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:14:47.489410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:47.554209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1257/2504] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:14:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:14:47.565849 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.567500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:14:47.623381 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e634218-0a24-4157-9612-38e2ffc952cc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.627057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.627690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.627975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.628274 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.637093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.638642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.647785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1248/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:14:47.869060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:14:47.878325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296b42-bbb4-4689-8f7e-a997a52e6789 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:14:47.881828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:14:47.882489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:14:47.882765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:14:47.883038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:14:47.938411 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:14:47.939840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96604b-2974-44e4-ab77-e7fc2a8736c6 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:14:47.948648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1258/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:14:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:15:01.886898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:01.945513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525ac21-8808-43f8-bdd9-921f9521d849 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:01.949976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:01.950829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:01.951105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:01.951379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] PATH_INFO: `/v3/users/699648b5e706432ea2a9a6d792119eb7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:01.952614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699648b5e706432ea2a9a6d792119eb7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:01.954504 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:02.179441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699648b5e706432ea2a9a6d792119eb7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:02.250620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699648b5e706432ea2a9a6d792119eb7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:02.263093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699648b5e706432ea2a9a6d792119eb7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:02.263790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699648b5e706432ea2a9a6d792119eb7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:02.264416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699648b5e706432ea2a9a6d792119eb7'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:02.276595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1249/2507] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:01 2022] DELETE /identity/v3/users/699648b5e706432ea2a9a6d792119eb7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:02.281169 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:02.281672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:02.282215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:02.299255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:02.300450 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:02.358422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1259/2508] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:02.365383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:02.366824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:02.367917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:02.370122 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:02.423814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de16128-e9f5-4204-b848-bcf08f92d220 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:02.424554 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ded56-45ac-47ab-a489-fc33b1f52372 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:02.427551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:02.428067 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:02.428342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:02.428691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:02.428788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:02.428967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:02.429185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:02.429293 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:02.431706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:02.438789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:02.440214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:02.449472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1260/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:02.494532 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:02.496065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:02.513603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1250/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:02.870457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:02.871989 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:02.887164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c8f0-9473-467e-90a6-e487b6444aef service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:02.892784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:02.893808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:02.894081 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:02.894387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] PATH_INFO: `/v3/projects/e8e519e0ce1a48229ba51331b2ad43f0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:02.895557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e519e0ce1a48229ba51331b2ad43f0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:02.897651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:03.010795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e519e0ce1a48229ba51331b2ad43f0', 'request_id': 'req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.016997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e519e0ce1a48229ba51331b2ad43f0', 'request_id': 'req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.022706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e519e0ce1a48229ba51331b2ad43f0', 'request_id': 'req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.167234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] The token cache is being invalidate because project e8e519e0ce1a48229ba51331b2ad43f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:03.167522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.168162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.169754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1261/2511] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:02 2022] DELETE /identity/v3/projects/e8e519e0ce1a48229ba51331b2ad43f0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:03.173712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:03.184712 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147453-249d-4a96-b178-592178f2e989 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:03.239438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:03.240308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:03.240589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:03.240859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] PATH_INFO: `/v3/users/1e61c229c8bf4dc2bc5948cbd2d79c46` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:03.242053 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e61c229c8bf4dc2bc5948cbd2d79c46)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:03.244814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:03.472862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e61c229c8bf4dc2bc5948cbd2d79c46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.556351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e61c229c8bf4dc2bc5948cbd2d79c46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.568674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e61c229c8bf4dc2bc5948cbd2d79c46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.574502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e61c229c8bf4dc2bc5948cbd2d79c46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.574502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e1786f0c-8752-4e23-a6cb-264e368c2b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e61c229c8bf4dc2bc5948cbd2d79c46'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:03.583446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1251/2512] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:03 2022] DELETE /identity/v3/users/1e61c229c8bf4dc2bc5948cbd2d79c46 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:04.379533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:04.381600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:04.395414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1864-b8d3-4cb8-a5cb-f57f936b5e4e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:04.464208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:04.465063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:04.465337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:04.465637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] PATH_INFO: `/v3/projects/c861b82c385a48a491bdea10eff85201` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:04.466813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c861b82c385a48a491bdea10eff85201)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:04.468717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:04.557498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c861b82c385a48a491bdea10eff85201', 'request_id': 'req-04772c66-e812-422e-9bf7-3c61b5ac7dee'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:04.563589 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c861b82c385a48a491bdea10eff85201', 'request_id': 'req-04772c66-e812-422e-9bf7-3c61b5ac7dee'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:04.569384 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c861b82c385a48a491bdea10eff85201', 'request_id': 'req-04772c66-e812-422e-9bf7-3c61b5ac7dee'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:04.664310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] The token cache is being invalidate because project c861b82c385a48a491bdea10eff85201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:04.668834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:04.668834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04772c66-e812-422e-9bf7-3c61b5ac7dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:04.668834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1262/2513] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:04 2022] DELETE /identity/v3/projects/c861b82c385a48a491bdea10eff85201 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:04.673074 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:04.673598 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:04.673694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:04.691850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:04.693075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:04.758774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1252/2514] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:04.766493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:04.766851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:04.767210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:04.791488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:04.792848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:04.800972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1263/2515] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:04.805513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:04.815229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21dad8-3b8a-4a0c-a5f7-152845d13f5f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:04.820301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:04.820704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:04.821100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:04.821569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:04.822355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:04.822757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:04.824445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:04.836254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1253/2516] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:04.841774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:04.851517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d68961-abec-480a-9f4c-8b262fa19df3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:04.857834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:04.858610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:04.859007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:04.859380 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:04.860160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:04.862432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:04.970435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1264/2517] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:04 2022] POST /identity/v3/projects => generated 397 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:04.975048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:04.989121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1049b-41ee-4ac3-9fbc-8d1105085e29 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.052814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.053542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.053830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.054107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.054807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.057032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.157836 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1254/2518] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:04 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:05.161789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.172673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029085c8-2781-458c-b2a4-028a278ae3de admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.181752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.181752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.181752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.181752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.182189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.183004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.193834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1265/2519] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:05.198608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.208944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4b73-4326-4a04-9335-6eff3b5f8264 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.214327 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.215001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.215270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.215545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.216267 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.217968 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c1ab6-446f-4b1e-9988-fd3c7e1142c2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.228665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1255/2520] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:05.232592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.243123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406e93-ad60-4add-bd03-d4b6ecd93957 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.248398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.249270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.249587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.249859 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] PATH_INFO: `/v3/projects/e99f9703384849c0b7c7d60789df1e26/users/8140222b899e4203afcb3e101ddfc862/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.265663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99f9703384849c0b7c7d60789df1e26, user_id=8140222b899e4203afcb3e101ddfc862, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.268329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.334396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1266/2521] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:05 2022] PUT /identity/v3/projects/e99f9703384849c0b7c7d60789df1e26/users/8140222b899e4203afcb3e101ddfc862/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:05.345491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.345789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.346075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.374427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] MFA Rules not processed for user `8140222b899e4203afcb3e101ddfc862`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:05.375703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:05.442198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1256/2522] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:05.447338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.508189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817f9-27d9-4b9d-ab5b-65bdfa67e0df admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.513407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.514088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.514368 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.514639 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.515324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.517277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.624415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1267/2523] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:05 2022] POST /identity/v3/projects => generated 401 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:05.625572 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.638355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d5bd-cf7e-4002-b10b-4e38c6cf8213 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.698092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.698766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.699042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.699317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.700013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.701989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.809102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1257/2524] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:05 2022] POST /identity/v3/users => generated 307 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:05.813259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.824381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d744d-fa80-400c-8c96-c9ad995d9b22 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.828929 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.829615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.829898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.830172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.830887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.832502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.842725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1268/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:05.857622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:05.867625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5cf0-1570-4782-8848-44f121f587bc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:05.872987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:05.873891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:05.874176 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:05.874501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] PATH_INFO: `/v3/projects/a928121aa6944cf2b4f6212463838a26/users/da660ff5f592461abe062b3d34b55604/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:05.889385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928121aa6944cf2b4f6212463838a26, user_id=da660ff5f592461abe062b3d34b55604, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:05.892070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:05.997787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1258/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:05 2022] PUT /identity/v3/projects/a928121aa6944cf2b4f6212463838a26/users/da660ff5f592461abe062b3d34b55604/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:06.001806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:06.011550 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe84d0d-0be9-48af-bbad-a598bfd752f3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:06.064971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:06.065653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:06.065959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:06.066233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:06.066944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:06.068534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caff2c-4250-4108-a29c-55799a8821eb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:06.078252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1269/2527] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:06.082587 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:06.092788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c33-36a7-4389-b8ba-2df9c656f678 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:06.097455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:06.098347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:06.098632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:06.098911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] PATH_INFO: `/v3/projects/a928121aa6944cf2b4f6212463838a26/users/da660ff5f592461abe062b3d34b55604/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:06.100891 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928121aa6944cf2b4f6212463838a26, user_id=da660ff5f592461abe062b3d34b55604, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:06.104096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:06.114973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1259/2528] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:06 2022] PUT /identity/v3/projects/a928121aa6944cf2b4f6212463838a26/users/da660ff5f592461abe062b3d34b55604/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:06.127362 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:06.127588 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:06.127863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:06.155429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] MFA Rules not processed for user `da660ff5f592461abe062b3d34b55604`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:06.156631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:06.220600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1270/2529] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:06.231604 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:06.233280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:06.288833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0621f55-0048-4eb7-b230-db9f35d9a8a9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:06.293064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:06.293727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:06.294013 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:06.294289 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:06.303031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:06.304467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:06.313616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1260/2530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:06.567040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:06.576549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b0de-7309-4b2a-9d48-225a8c5b3e7c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:06.580088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:06.580732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:06.580991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:06.581263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:06.639581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:06.640931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d5f3-371f-4262-a920-ab3f5bff71d9 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:06.650682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1271/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:12.712129 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:12.771562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fac9-0e50-4436-a1c8-dd11f821b4d7 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:12.776790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:12.777685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:12.777964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:12.778236 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] PATH_INFO: `/v3/users/8140222b899e4203afcb3e101ddfc862` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:12.779672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8140222b899e4203afcb3e101ddfc862)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:12.781656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:12.969833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8140222b899e4203afcb3e101ddfc862'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.039848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8140222b899e4203afcb3e101ddfc862'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.051147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8140222b899e4203afcb3e101ddfc862'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.051772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8140222b899e4203afcb3e101ddfc862'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.052417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8140222b899e4203afcb3e101ddfc862'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.064618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1261/2532] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:12 2022] DELETE /identity/v3/users/8140222b899e4203afcb3e101ddfc862 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:13.069100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:13.069583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:13.069824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:13.087313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:13.088495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:13.146247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1272/2533] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:13.155985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:13.157383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:13.213374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c291-150e-423d-b7d4-d348cb77ce99 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:13.216994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:13.217657 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:13.219519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:13.219953 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:13.229385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:13.230862 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:13.243468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1262/2534] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:13.797862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:13.799286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:13.812697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b43dc-9e83-4f64-9fa1-c6ab917e842c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:13.817543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:13.818417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:13.818700 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:13.818983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] PATH_INFO: `/v3/projects/e99f9703384849c0b7c7d60789df1e26` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:13.820219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99f9703384849c0b7c7d60789df1e26)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:13.822210 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:13.956930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99f9703384849c0b7c7d60789df1e26', 'request_id': 'req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.963804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99f9703384849c0b7c7d60789df1e26', 'request_id': 'req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:13.969463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99f9703384849c0b7c7d60789df1e26', 'request_id': 'req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.049028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] The token cache is being invalidate because project e99f9703384849c0b7c7d60789df1e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:14.049335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.050051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.051934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1273/2535] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:13 2022] DELETE /identity/v3/projects/e99f9703384849c0b7c7d60789df1e26 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:14.062164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:14.072622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee540c0b-038d-42b4-bcf9-ecb9ff46e842 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:14.138418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:14.139541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:14.139872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:14.140151 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] PATH_INFO: `/v3/users/da660ff5f592461abe062b3d34b55604` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:14.141477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=da660ff5f592461abe062b3d34b55604)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:14.143636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:14.353494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da660ff5f592461abe062b3d34b55604'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.446243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da660ff5f592461abe062b3d34b55604'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.461300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da660ff5f592461abe062b3d34b55604'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.462066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da660ff5f592461abe062b3d34b55604'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.462710 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ab536e14-af1d-4f5e-91b0-979872ab1fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da660ff5f592461abe062b3d34b55604'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:14.475740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1263/2536] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:14 2022] DELETE /identity/v3/users/da660ff5f592461abe062b3d34b55604 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:14.970060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:14.981211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:14.987510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed82ce9-162c-4de4-bf58-ecd79c987f9d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.047789 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.048570 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.048854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.049131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] PATH_INFO: `/v3/projects/a928121aa6944cf2b4f6212463838a26` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.050458 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a928121aa6944cf2b4f6212463838a26)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.052373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.185499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a928121aa6944cf2b4f6212463838a26', 'request_id': 'req-266efd5c-c98f-4613-932d-a6ace6e56076'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:15.191487 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a928121aa6944cf2b4f6212463838a26', 'request_id': 'req-266efd5c-c98f-4613-932d-a6ace6e56076'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:15.196677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a928121aa6944cf2b4f6212463838a26', 'request_id': 'req-266efd5c-c98f-4613-932d-a6ace6e56076'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:15.394131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] The token cache is being invalidate because project a928121aa6944cf2b4f6212463838a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:15.396527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:15.396527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-266efd5c-c98f-4613-932d-a6ace6e56076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:15.396527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1274/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:14 2022] DELETE /identity/v3/projects/a928121aa6944cf2b4f6212463838a26 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:15.401979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.402456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.402568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.420302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:15.421623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:15.482165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1264/2538] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:15.485921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.486234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.486508 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.504785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:15.505999 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:15.513982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1275/2539] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:15.518100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.527888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90564-1eeb-4892-bb6f-906656ce1d35 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.532360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.532981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.533257 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.533566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.534281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:15.534580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.536157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.547696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1265/2540] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:15.551973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.561042 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031433c6-d8a8-4220-93ba-a231c69ea833 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.565666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.566379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.566665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.566935 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.567620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.569520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.673011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1276/2541] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:15 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:15.677035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.686991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97a9e-64fd-4d2c-be96-93538df65956 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.742597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.743266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.743543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.743814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.744499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.746707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.860656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1266/2542] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:15 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:15.864802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.875184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc725f1-ec4e-4b6a-95f3-ae05d31fb5aa admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.879730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.881357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.881357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.881357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.881714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.883255 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.893980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1277/2543] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:15.897934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.909262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7718-2329-4959-b22a-361c1e3d0b39 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.914285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.914978 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.915260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.915758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.916528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.918214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cd30c-db42-4127-9d80-8f4bbe96c4a3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:15.929139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1267/2544] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:15.933680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:15.944787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6ff4-71b5-4c08-baf1-54fabd2f68c3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:15.949985 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:15.950880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:15.951154 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:15.951422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] PATH_INFO: `/v3/projects/c49bbdde41804c44ba461d2b6eb9fcf1/users/568dcc152f0d422f8404a559e53b6ffe/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:15.966652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49bbdde41804c44ba461d2b6eb9fcf1, user_id=568dcc152f0d422f8404a559e53b6ffe, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:15.969312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.078645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1278/2545] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:15 2022] PUT /identity/v3/projects/c49bbdde41804c44ba461d2b6eb9fcf1/users/568dcc152f0d422f8404a559e53b6ffe/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:16.090600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.090892 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.091171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.117882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] MFA Rules not processed for user `568dcc152f0d422f8404a559e53b6ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:16.119900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:16.184142 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1268/2546] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:16.188515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.252701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549181-64d2-425e-9403-8112452d92d0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.257879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.258532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.258812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.259080 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.259822 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.262388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.365026 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1279/2547] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:16 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:16.369636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.384063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e76a3-e2d2-4e48-b992-01a3f268b4b5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.442775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.443442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.443717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.443990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.444671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.446612 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.568528 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1269/2548] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:16 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:16.572640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.582660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b79d28-a601-48db-a442-8ef485c59fd3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.587130 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.587774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.588051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.588323 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.589038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.590658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.600760 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1280/2549] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:16.605321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.615077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e066-1ed2-4c48-bc2a-cf31d98effbc admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.620636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.621541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.621888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.622260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] PATH_INFO: `/v3/projects/7ebfa51e5000493c8ba3dad90eedd999/users/bc14a2a2ddcd4eff9eefda5a123e03b7/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.637719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebfa51e5000493c8ba3dad90eedd999, user_id=bc14a2a2ddcd4eff9eefda5a123e03b7, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.640371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.760774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1270/2550] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:16 2022] PUT /identity/v3/projects/7ebfa51e5000493c8ba3dad90eedd999/users/bc14a2a2ddcd4eff9eefda5a123e03b7/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:16.803943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.803943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39bd83-9551-4534-b5a3-bb8ab309b079 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.829785 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.830451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.830733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.831009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.831719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.833319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090bba0-3419-406f-b7bb-e4a7399190c4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.843768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1281/2551] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:16.847989 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:16.858879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f91b-4127-425d-8d4c-7d786ad7e7b9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:16.863501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:16.864370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.864646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.864943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] PATH_INFO: `/v3/projects/7ebfa51e5000493c8ba3dad90eedd999/users/bc14a2a2ddcd4eff9eefda5a123e03b7/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.866910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebfa51e5000493c8ba3dad90eedd999, user_id=bc14a2a2ddcd4eff9eefda5a123e03b7, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:16.869624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:16.888139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1271/2552] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:16 2022] PUT /identity/v3/projects/7ebfa51e5000493c8ba3dad90eedd999/users/bc14a2a2ddcd4eff9eefda5a123e03b7/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:16.897234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:16.897645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:16.897951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:16.924347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] MFA Rules not processed for user `bc14a2a2ddcd4eff9eefda5a123e03b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:16.925557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:16.989511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1282/2553] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:17.001317 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:17.003063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:17.058359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431164-f954-436f-b022-9664da144f25 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:17.061973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:17.062599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:17.062883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:17.063156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:17.072010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:17.073534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:17.083287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1272/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:17.253460 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:17.263405 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca2e7-87e6-470b-9a9a-9711b04e2a6c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:17.266957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:17.275871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:17.275871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:17.275871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:17.324583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:17.326202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:17.335109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1283/2555] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:17.804877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:17.867764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4380916-e68d-4719-a163-e76f3cb209c1 service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:17.873672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:17.874545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:17.874828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:17.875106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] PATH_INFO: `/v3/users/568dcc152f0d422f8404a559e53b6ffe` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:17.876642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=568dcc152f0d422f8404a559e53b6ffe)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:17.878728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:18.106282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568dcc152f0d422f8404a559e53b6ffe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:18.124801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:18.134307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857899-826e-4c86-85ec-336a63750146 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:18.140156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:18.140823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:18.141107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:18.141383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:18.143576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:18.201139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568dcc152f0d422f8404a559e53b6ffe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:18.215316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568dcc152f0d422f8404a559e53b6ffe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:18.216152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568dcc152f0d422f8404a559e53b6ffe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:18.216823 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9a7a2ea6-bdfb-45f7-b685-096d489a16ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568dcc152f0d422f8404a559e53b6ffe'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:18.231578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1273/2556] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:17 2022] DELETE /identity/v3/users/568dcc152f0d422f8404a559e53b6ffe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:18.236188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:18.242947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:18.242947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:18.243145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:18.243145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:18.254492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:18.255702 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:18.258520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1284/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:15:18.330251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1274/2558] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:18.341568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:18.343073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:18.404819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ca9d-3199-4637-b521-4c5fa2c99da5 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:18.456731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:18.457373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:18.457684 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:18.457956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:18.467415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:18.468836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:18.478274 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1285/2559] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:15:18.888856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:18.890366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:18.902994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917e661-5e84-44c5-8d05-3c90a0150223 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:18.909619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:18.910554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:18.910840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:18.911118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] PATH_INFO: `/v3/projects/c49bbdde41804c44ba461d2b6eb9fcf1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:18.912358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49bbdde41804c44ba461d2b6eb9fcf1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:18.914519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:19.034613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49bbdde41804c44ba461d2b6eb9fcf1', 'request_id': 'req-044da53f-11f1-4759-85c2-3daf219ef05b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.040605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49bbdde41804c44ba461d2b6eb9fcf1', 'request_id': 'req-044da53f-11f1-4759-85c2-3daf219ef05b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.046524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49bbdde41804c44ba461d2b6eb9fcf1', 'request_id': 'req-044da53f-11f1-4759-85c2-3daf219ef05b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.120061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] The token cache is being invalidate because project c49bbdde41804c44ba461d2b6eb9fcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:19.120344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.121316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.122924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1275/2560] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:18 2022] DELETE /identity/v3/projects/c49bbdde41804c44ba461d2b6eb9fcf1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:19.127095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:19.137224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa2570-5fc4-46d9-990f-57aee7c26f1c service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:19.189942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:19.190814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:19.191076 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:19.191349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] PATH_INFO: `/v3/users/bc14a2a2ddcd4eff9eefda5a123e03b7` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:19.192606 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc14a2a2ddcd4eff9eefda5a123e03b7)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:19.194603 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:19.366466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc14a2a2ddcd4eff9eefda5a123e03b7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.440933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc14a2a2ddcd4eff9eefda5a123e03b7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.453373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc14a2a2ddcd4eff9eefda5a123e03b7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.454038 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc14a2a2ddcd4eff9eefda5a123e03b7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.460587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3131f74b-742a-405c-bdb8-f130a7c82691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc14a2a2ddcd4eff9eefda5a123e03b7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:19.467107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1286/2561] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:19 2022] DELETE /identity/v3/users/bc14a2a2ddcd4eff9eefda5a123e03b7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:19.867518 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:19.868980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:19.881986 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044da53f-11f1-4759-85c2-3daf219ef05b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:19.940153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:19.941017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:19.941300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:19.941597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] PATH_INFO: `/v3/projects/7ebfa51e5000493c8ba3dad90eedd999` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:19.942828 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebfa51e5000493c8ba3dad90eedd999)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:19.944696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.069105 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebfa51e5000493c8ba3dad90eedd999', 'request_id': 'req-426d394e-4bfd-4a45-82b7-f3b34ce39a54'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:20.075337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebfa51e5000493c8ba3dad90eedd999', 'request_id': 'req-426d394e-4bfd-4a45-82b7-f3b34ce39a54'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:20.081022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebfa51e5000493c8ba3dad90eedd999', 'request_id': 'req-426d394e-4bfd-4a45-82b7-f3b34ce39a54'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:20.168420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] The token cache is being invalidate because project 7ebfa51e5000493c8ba3dad90eedd999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:20.168648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:20.169262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-426d394e-4bfd-4a45-82b7-f3b34ce39a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:20.170956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1276/2562] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:19 2022] DELETE /identity/v3/projects/7ebfa51e5000493c8ba3dad90eedd999 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:20.175793 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.176083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.176363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.193400 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:20.194612 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.250858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1287/2563] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:20.258351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.258640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.258918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.278832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:20.280031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.288010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1277/2564] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:20.292236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.302851 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd4c6c-148d-4dbd-a980-177cd8da414d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.307601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.308272 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.308553 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.308826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.309584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:20.309892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.311490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.323513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1288/2565] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:20.327850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.336991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f93c-fb50-4734-bac9-b46f4278c01d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.342124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.342760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.343039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.343313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.344004 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.345948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.431481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1278/2566] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:20 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:20.435636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.445635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066450d5-5dfe-41e5-a953-038c93290e53 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.499543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.500193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.500472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.500743 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.501496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.503345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.594916 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1289/2567] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:20 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:20.598972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.608940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f99e-c1e0-4369-b9bb-2f14c55096b5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.613918 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.614568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.614844 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.615113 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.615820 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.617397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.629035 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1279/2568] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:20.632656 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.643160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316bc7e-292d-459c-98ab-07942841363a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.647818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.648442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.648719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.648995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.649738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.651345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.667722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1290/2569] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:20.673320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.685088 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8335-6dfc-45d2-bc48-eb480762f52e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.689804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.690818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.691102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.691378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] PATH_INFO: `/v3/projects/2293f90bbcab477c880aaec36960c84d/users/5330b2b7b44a47ffb2eca2675c7cb5db/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.704444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.706590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.707663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2293f90bbcab477c880aaec36960c84d, user_id=5330b2b7b44a47ffb2eca2675c7cb5db, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.710484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.765959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ca2e-b5f9-4277-9869-c1d0cf2c3451 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:20.769551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:20.770187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.770462 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.770733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.772522 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.784546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:20.786172 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c5e81-f20d-4a47-9399-57d52207b448 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:20.796369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1291/2570] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:15:20.801307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1280/2571] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:20 2022] PUT /identity/v3/projects/2293f90bbcab477c880aaec36960c84d/users/5330b2b7b44a47ffb2eca2675c7cb5db/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:20.812839 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:20.813139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:20.813423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:20.842252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] MFA Rules not processed for user `5330b2b7b44a47ffb2eca2675c7cb5db`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:20.843506 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.926170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1292/2572] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:20.935239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:20.937158 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:20.997009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f40ce-e95d-4ac6-aae2-140317dda8f2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:21.001291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:21.001965 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:21.002245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:21.002520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:21.011809 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:21.013391 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2f25-7d91-4deb-844b-2ce394fd2b58 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:21.025039 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1281/2573] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:21.045351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:21.111803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585bf1a-f311-4e10-a7d1-8393e4443bb9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:21.117413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:21.118436 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:21.118778 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:21.119112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] PATH_INFO: `/v3/users/5330b2b7b44a47ffb2eca2675c7cb5db` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:21.121416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5330b2b7b44a47ffb2eca2675c7cb5db)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:21.123767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:21.482526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5330b2b7b44a47ffb2eca2675c7cb5db'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:21.572892 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5330b2b7b44a47ffb2eca2675c7cb5db'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:21.586560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5330b2b7b44a47ffb2eca2675c7cb5db'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:21.589766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5330b2b7b44a47ffb2eca2675c7cb5db'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:21.595354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5330b2b7b44a47ffb2eca2675c7cb5db'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:21.601899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1293/2574] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:21 2022] DELETE /identity/v3/users/5330b2b7b44a47ffb2eca2675c7cb5db => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:21.606669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:21.606961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:21.607240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:21.625831 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:21.627082 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:21.694221 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1282/2575] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:21.704425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:21.706141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:21.740670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:21.742339 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:21.786967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889d6b-53f9-4a55-b7cb-c948fe6b8d9c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:21.800732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:21.801397 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:21.801823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:21.802109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:21.819334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:21.820815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:21.827290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc405b47-5ab5-42fe-abac-11e9e79ae7f7 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:21.832901 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:21.833896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:21.836865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:21.837392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:21.839656 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:21.851593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1294/2576] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:21.854950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:21.856622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6756ef-5ca1-41a7-97d8-dc48801d03d9 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:21.870364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1283/2577] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:22.795828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:22.797520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:22.820126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f8b1-1d21-499c-a00a-e1cf654e02eb service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:22.826161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:22.827283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:22.827726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:22.828176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] PATH_INFO: `/v3/projects/2293f90bbcab477c880aaec36960c84d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:22.829835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2293f90bbcab477c880aaec36960c84d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:22.831856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:22.959446 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2293f90bbcab477c880aaec36960c84d', 'request_id': 'req-0e56a655-1910-4dde-8a2f-7ea51864bd4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:22.966485 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2293f90bbcab477c880aaec36960c84d', 'request_id': 'req-0e56a655-1910-4dde-8a2f-7ea51864bd4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:22.973129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2293f90bbcab477c880aaec36960c84d', 'request_id': 'req-0e56a655-1910-4dde-8a2f-7ea51864bd4b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:23.067577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] The token cache is being invalidate because project 2293f90bbcab477c880aaec36960c84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:23.071843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:23.071843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0e56a655-1910-4dde-8a2f-7ea51864bd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:23.071843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1295/2578] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:22 2022] DELETE /identity/v3/projects/2293f90bbcab477c880aaec36960c84d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:23.076107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.076649 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.076744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.101751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:23.103405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:23.172886 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1284/2579] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:23.180781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.181070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.181344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.201271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:23.202636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:23.210755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1296/2580] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:23.214967 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.225067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bef7a-0170-46dc-b795-dfea06ebb87b None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.229829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.230486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.230771 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.231047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.231773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:23.232101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.233715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.251446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1285/2581] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:23.251584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.260329 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c8ea-b671-4a2a-addb-eae78fb671a1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.265243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.265931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.266215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.266490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.267187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.269133 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.351232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1297/2582] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:23 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:23.356079 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.366020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf573f5-d4a5-4f55-bbdf-500bddc0865e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.431198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.431840 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.432671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.432974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.433724 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.435725 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.505738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1286/2583] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:23 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:23.510180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.532347 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294685f-3be1-45ff-aaf9-fc82b6b33697 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.548486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.549413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.549909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.550338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.551217 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.553313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.577708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1298/2584] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:23.583161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.595493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1a5d-549f-428a-8d6b-e4b7b3e3caa6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.600480 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.601152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.601427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.601737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.602462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.606601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe3395-7dde-4704-bac7-e3b01a268e82 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.627424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1287/2585] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:23.628604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.647500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7945b4-d3da-431f-8fc9-4926ae2ecc04 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:23.654764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:23.655089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.655418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.655697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] PATH_INFO: `/v3/projects/f717292fc4ad4e8da1192b932f4de751/users/b8fa805361554c05a54368e41b46f61c/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.679104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f717292fc4ad4e8da1192b932f4de751, user_id=b8fa805361554c05a54368e41b46f61c, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:23.683409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:23.817233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1299/2586] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:23 2022] PUT /identity/v3/projects/f717292fc4ad4e8da1192b932f4de751/users/b8fa805361554c05a54368e41b46f61c/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:23.827611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:23.828008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:23.828356 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:23.869117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] MFA Rules not processed for user `b8fa805361554c05a54368e41b46f61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:23.870727 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:23.979863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1288/2587] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:23.993321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:23.997089 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:24.061604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a82e3-4936-4636-a809-ec8679098b5d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:24.065253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:24.065941 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:24.066224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:24.066499 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:24.075952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:24.077566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:24.087376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1300/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:25.082717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:25.084163 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:25.102490 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:25.104065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:25.147949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6026a7-516d-47ff-a402-7e79e4c666a0 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:25.151640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:25.152287 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:25.152569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:25.152846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:25.154747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:25.164545 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:25.166024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:25.174200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1289/2589] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:25.175174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884f01-466a-446a-897b-e1f04efe9974 service glance] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:25.179926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:25.180861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:25.181137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:25.181407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] PATH_INFO: `/v3/users/d2bd1b793a33487b834c4684b7c31231` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:25.196451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bd1b793a33487b834c4684b7c31231)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:25.200360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:25.404324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bd1b793a33487b834c4684b7c31231'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:25.489177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bd1b793a33487b834c4684b7c31231'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:25.504876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bd1b793a33487b834c4684b7c31231'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:25.505659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bd1b793a33487b834c4684b7c31231'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:25.512992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86dcd1fa-ddce-4277-bbde-a29033abc19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bd1b793a33487b834c4684b7c31231'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:25.519165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1301/2590] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:25 2022] DELETE /identity/v3/users/d2bd1b793a33487b834c4684b7c31231 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:15:26.011462 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.025455 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529c693-9506-4fd6-8a24-4da8f2a756dd service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.081584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.082431 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.082758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.083262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] PATH_INFO: `/v3/projects/b46a240be5e84bd7bde99fc7a8628b61` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.094202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46a240be5e84bd7bde99fc7a8628b61)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.096187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.212085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46a240be5e84bd7bde99fc7a8628b61', 'request_id': 'req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:26.219684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46a240be5e84bd7bde99fc7a8628b61', 'request_id': 'req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:26.225405 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46a240be5e84bd7bde99fc7a8628b61', 'request_id': 'req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:26.305683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] The token cache is being invalidate because project b46a240be5e84bd7bde99fc7a8628b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:26.306006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:26.306608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e2aa15ea-c2ea-4937-9da0-e4a6347c2a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:26.308256 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1290/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:26 2022] DELETE /identity/v3/projects/b46a240be5e84bd7bde99fc7a8628b61 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:26.313218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.313706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.313849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.331423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:26.332597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:26.398312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1302/2592] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:26.407002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.409489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.409489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.426104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:26.427276 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:26.435063 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1291/2593] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:26.439387 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.449406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650aca8-dfb1-4022-8ad2-68916558055c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.455432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.455432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.455432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.455432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.455826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:26.456131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.457757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.469677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1303/2594] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:26.473923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.482905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c393e9-cb9c-4f7b-be07-a7c8fc424b34 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.487479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.488112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.488392 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.488664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.489348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.491302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.604988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1292/2595] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:26.609271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.619054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2315c-d8c4-4406-88ca-0db31d79adf5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.672843 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.673530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.673813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.674087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.674767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.676931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.769595 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1304/2596] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:26 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:26.773737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.784059 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2c0fc-a3a7-4506-ae6f-3b6e1ed33163 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.788713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.789357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.789681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.791537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.791537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.792384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.803030 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1293/2597] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:26.806986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.817198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326ed1b-2b5b-4641-adbb-783c145f32be admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.821849 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.825975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.825975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.825975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.825975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.825975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084ee30-6b7d-48c1-a91d-9db7d13837d3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.835454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1305/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:26.839445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:26.849040 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41912-2339-4b32-8eab-6a1117eac955 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:26.853632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:26.854494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.854768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.855089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] PATH_INFO: `/v3/projects/ddcbc1fbe336493aa7711a57c54b04b3/users/5237ff4781dd4e93a6a3e67b11bd8268/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:26.868887 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcbc1fbe336493aa7711a57c54b04b3, user_id=5237ff4781dd4e93a6a3e67b11bd8268, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:26.872360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:26.972733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1294/2599] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:26 2022] PUT /identity/v3/projects/ddcbc1fbe336493aa7711a57c54b04b3/users/5237ff4781dd4e93a6a3e67b11bd8268/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:26.984029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:26.984586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:26.984887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:27.015166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] MFA Rules not processed for user `5237ff4781dd4e93a6a3e67b11bd8268`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:27.016316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:27.081030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1306/2600] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:27.092283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:27.094118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:27.165066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8d51-d30b-471a-9742-6d6141ff2816 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:27.170558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:27.171259 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:27.171534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:27.171808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:27.179320 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:27.180963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:27.189882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1295/2601] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:15:27.517189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:27.520312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:27.573681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fa7d-a3f1-4f23-a851-992684b382c5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:27.577321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:27.577979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:27.578264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:27.578540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:27.580295 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:27.644561 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:27.646087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:27.656285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1307/2602] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:31.342291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:31.343760 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:31.359956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82710a-3504-4051-bf21-1a89c2c83022 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:31.364683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:31.365589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:31.365878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:31.366160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] PATH_INFO: `/v3/users/45f516e419574132b8760971af6146c5` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:31.367378 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f516e419574132b8760971af6146c5)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:31.369484 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:31.534162 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f516e419574132b8760971af6146c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:31.609566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f516e419574132b8760971af6146c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:31.622225 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f516e419574132b8760971af6146c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:31.622856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f516e419574132b8760971af6146c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:31.623456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b568232f-e9e9-4d96-9f00-093d1c8f4eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f516e419574132b8760971af6146c5'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:31.635288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1296/2603] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:31 2022] DELETE /identity/v3/users/45f516e419574132b8760971af6146c5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:31.886226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:31.898940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc028-50f1-4e8c-a369-0270924e8d97 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:31.957342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:31.958265 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:31.958569 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:31.958825 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] PATH_INFO: `/v3/projects/fdd86f8650a9453bb06500b0b0aa31e7` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:31.960003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd86f8650a9453bb06500b0b0aa31e7)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:31.962057 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.103640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd86f8650a9453bb06500b0b0aa31e7', 'request_id': 'req-4af9d7c2-913c-49e5-ac02-357352481c31'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:32.109600 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd86f8650a9453bb06500b0b0aa31e7', 'request_id': 'req-4af9d7c2-913c-49e5-ac02-357352481c31'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:32.114754 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd86f8650a9453bb06500b0b0aa31e7', 'request_id': 'req-4af9d7c2-913c-49e5-ac02-357352481c31'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:32.186578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] The token cache is being invalidate because project fdd86f8650a9453bb06500b0b0aa31e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:32.186863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:32.187472 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4af9d7c2-913c-49e5-ac02-357352481c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:32.188980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1308/2604] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:31 2022] DELETE /identity/v3/projects/fdd86f8650a9453bb06500b0b0aa31e7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:32.193948 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.194241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.194523 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.211692 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:32.212874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:32.269745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1297/2605] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:32.277363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.277747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.278024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.297166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:32.298449 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:32.306729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1309/2606] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:32.311941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.322520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053a3f9-36d1-41c0-86f7-3c83d6bc7526 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.327334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.328029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.328310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.328585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.329332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:32.329667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.331363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.347305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1298/2607] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:32.349219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.359792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f103-d9a4-42cf-8655-65eb42c2fe59 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.364601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.365282 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.365598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.365873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.366586 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.368536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.463808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1310/2608] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:32 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:32.468075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.478360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e91d-d104-436c-809c-9134fbfa3b15 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.534097 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.534753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.535036 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.535308 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.535991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.537924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.625200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1299/2609] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:32 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:32.629146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.639672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc3f1-4dd8-45f9-9780-9ac82fbf5962 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.644317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.646861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.646861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.646861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.646861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.647866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.658537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1311/2610] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:32.662440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.672767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dca4-6fa8-4ebd-8fb7-c05378d7f690 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.677674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.678333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.678618 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.678898 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.679624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.681222 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd44824-c36f-4ce8-b472-28959b43129f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.691025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1300/2611] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:15:32.694903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.704568 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2de0d-43a2-491c-b88e-845a1060c46a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.709498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.710468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.710768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.711043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] PATH_INFO: `/v3/projects/9a5c3b1304374510a7c267cd01eb59bf/users/accfbb9b8ce647959871870256990c68/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.728418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5c3b1304374510a7c267cd01eb59bf, user_id=accfbb9b8ce647959871870256990c68, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:32.732012 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:32.790139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1312/2612] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:32 2022] PUT /identity/v3/projects/9a5c3b1304374510a7c267cd01eb59bf/users/accfbb9b8ce647959871870256990c68/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:32.805174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.805495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.805815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:32.832569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] MFA Rules not processed for user `accfbb9b8ce647959871870256990c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:32.833808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:32.898546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1301/2613] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:32.910126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:32.911872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:32.988479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9b94e-9a95-443d-967d-e2c73d52ec0f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:32.994011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:32.994651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:32.994932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:32.995207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:33.003061 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:33.004641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a99960-e142-4f16-ac57-587984a0ff71 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:33.013769 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1313/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:33.187975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:33.248349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c86a3-2cee-45da-ac48-4bd5c4fd1ae5 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:33.252742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:33.253620 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:33.253902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:33.254174 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] PATH_INFO: `/v3/users/accfbb9b8ce647959871870256990c68` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:33.255334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accfbb9b8ce647959871870256990c68)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:33.257233 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:33.438689 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accfbb9b8ce647959871870256990c68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:33.498754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accfbb9b8ce647959871870256990c68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:33.511438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accfbb9b8ce647959871870256990c68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:33.512210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accfbb9b8ce647959871870256990c68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:33.512980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accfbb9b8ce647959871870256990c68'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:33.525092 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1302/2615] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:33 2022] DELETE /identity/v3/users/accfbb9b8ce647959871870256990c68 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:33.529563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:33.529854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:33.530395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:33.546842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:33.548029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:33.604030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1314/2616] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:33.613787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:33.615301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:33.673525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbf644-c0af-4c5e-b45d-29a09bc90555 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:33.677179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:33.677845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:33.678126 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:33.678399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:33.687879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:33.689370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80319e0b-fa1f-4870-923f-0de5afe7515e service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:33.698621 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1303/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:34.106512 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.107946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:34.119993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966be4-49a0-4496-9339-d2a97024e460 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.125475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.126339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.126623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.126898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] PATH_INFO: `/v3/projects/9a5c3b1304374510a7c267cd01eb59bf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.128087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5c3b1304374510a7c267cd01eb59bf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.130078 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.234626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5c3b1304374510a7c267cd01eb59bf', 'request_id': 'req-33e4e211-e8a8-4910-a38f-b14252e045df'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:34.240964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5c3b1304374510a7c267cd01eb59bf', 'request_id': 'req-33e4e211-e8a8-4910-a38f-b14252e045df'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:34.246804 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5c3b1304374510a7c267cd01eb59bf', 'request_id': 'req-33e4e211-e8a8-4910-a38f-b14252e045df'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:34.334129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] The token cache is being invalidate because project 9a5c3b1304374510a7c267cd01eb59bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:34.334416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:34.335044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-33e4e211-e8a8-4910-a38f-b14252e045df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:34.336633 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1315/2618] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:34 2022] DELETE /identity/v3/projects/9a5c3b1304374510a7c267cd01eb59bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:34.341880 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.342167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.342446 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.360107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:34.361295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:34.422837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1304/2619] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:34.428720 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.429005 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.429465 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.450415 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:34.451651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:34.459659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1316/2620] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:34.463935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.475445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8f0d2-d354-4580-8edf-93e6d34c996d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.482169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.482807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.483368 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.483638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.484349 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:34.484698 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.486260 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.498205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1305/2621] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:34.502319 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.511317 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a2f5-01af-45da-8bbe-9f9a592dc856 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.515995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.516627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.516909 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.517180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.517923 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.519818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.616898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1317/2622] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:34 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:34.623120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.632879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962523f-8825-4cb7-9620-953c6b7ae1f5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.690726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.691394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.691673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.691942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.692617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.694562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.769852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1306/2623] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:34 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:34.773877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.784468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16dac-48ec-4485-8724-87b11a5fdf9a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.789033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.789711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.790001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.790294 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.791009 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.792648 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.803266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1318/2624] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:34.809944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.819915 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906036e-e018-470a-8066-4c98ec52200d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.824534 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.825179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.825498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.825783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.826508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.828100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285368b-183b-4e13-ae2c-57aef39d2cf6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.837734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1307/2625] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:34.842181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:34.851887 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b1e6-5fb4-4c91-b18e-dd7f66f4777a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:34.857046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:34.857942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.858230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.858505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] PATH_INFO: `/v3/projects/e3ea9e2df9a941b098ea0c819d605e74/users/02c182726caf41e3bcb3d0617b7ffd66/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.872893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea9e2df9a941b098ea0c819d605e74, user_id=02c182726caf41e3bcb3d0617b7ffd66, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:34.875715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:34.934100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1319/2626] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:34 2022] PUT /identity/v3/projects/e3ea9e2df9a941b098ea0c819d605e74/users/02c182726caf41e3bcb3d0617b7ffd66/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:34.946010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:34.946294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:34.946565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:34.973367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] MFA Rules not processed for user `02c182726caf41e3bcb3d0617b7ffd66`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:34.974591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:35.036114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1308/2627] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:35.040645 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.101983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d006b-0fd7-4fdc-81f3-c4487c7d37ea admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.107209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.107847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.108123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.108394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.109091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.111054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.193741 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1320/2628] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:35 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:35.198117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.208954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c20d-a4ef-4b52-b4e7-65e5ae2a334d None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.263316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.263970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.264249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.264521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.265200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.267140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.367949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1309/2629] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:35 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:35.371837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.382306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96408c0-4b24-4188-98e3-06b9330054d2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.387457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.388106 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.388385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.388660 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.389407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.391052 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.400854 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1321/2630] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:15:35.405642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.415646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5db3d1-4c5f-478a-aac1-f2ce6106ba4f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.420213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.421080 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.421382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.421695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] PATH_INFO: `/v3/projects/ed3cb20ea19a4c549b5d532967c045ae/users/22e5c334e0cd46d59aa220f689d5a51a/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.435869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3cb20ea19a4c549b5d532967c045ae, user_id=22e5c334e0cd46d59aa220f689d5a51a, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.438542 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.510335 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1310/2631] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:35 2022] PUT /identity/v3/projects/ed3cb20ea19a4c549b5d532967c045ae/users/22e5c334e0cd46d59aa220f689d5a51a/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:15:35.515129 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.525006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fb9fc-896f-4176-ac73-47d13e524ee2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.578224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.578872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.579155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.579428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.580132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.581752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2c382-3abd-4fe1-981c-3dc1ad604937 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.591140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1322/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:35.595246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.605394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7911d03-fe0d-4179-8507-daa453f2ee12 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.609992 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.610851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.611214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.611499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] PATH_INFO: `/v3/projects/ed3cb20ea19a4c549b5d532967c045ae/users/22e5c334e0cd46d59aa220f689d5a51a/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.613581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3cb20ea19a4c549b5d532967c045ae, user_id=22e5c334e0cd46d59aa220f689d5a51a, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.616193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.627632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1311/2633] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:35 2022] PUT /identity/v3/projects/ed3cb20ea19a4c549b5d532967c045ae/users/22e5c334e0cd46d59aa220f689d5a51a/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:35.638524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.638726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.639003 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.675454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] MFA Rules not processed for user `22e5c334e0cd46d59aa220f689d5a51a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:35.676702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:35.742921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1323/2634] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:35.754799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:35.756490 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:35.811093 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26600d2-cb22-4a90-bec5-a8a9125ac57d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:35.814672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:35.815303 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:35.815588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:35.815865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:35.870790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:35.872273 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:35.881579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1312/2635] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:45.291288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:45.301828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57fb0f-3b7f-4e8c-9d09-a8f259eafe03 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:45.306677 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:45.307441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:45.307752 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:45.308029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:45.317233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:45.318768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e232d-69a8-4437-a882-13327a7bff73 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:45.330761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1324/2636] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:45.938112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:45.939547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:46.003673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf009e0-e120-42b6-aef2-e59379de884c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:46.008249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:46.009111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:46.009402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:46.009716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] PATH_INFO: `/v3/users/5237ff4781dd4e93a6a3e67b11bd8268` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:46.010869 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5237ff4781dd4e93a6a3e67b11bd8268)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:46.013398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:46.333499 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5237ff4781dd4e93a6a3e67b11bd8268'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:46.433681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5237ff4781dd4e93a6a3e67b11bd8268'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:46.446227 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5237ff4781dd4e93a6a3e67b11bd8268'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:46.446885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5237ff4781dd4e93a6a3e67b11bd8268'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:46.447488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5237ff4781dd4e93a6a3e67b11bd8268'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:46.459929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1313/2637] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:45 2022] DELETE /identity/v3/users/5237ff4781dd4e93a6a3e67b11bd8268 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:46.464577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:46.465053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:46.465201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:46.483160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:46.484351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:46.541031 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1325/2638] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:46.551475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:46.552903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:46.607873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77479c47-c8a2-49ea-acb1-fb2e5ded880c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:46.611463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:46.612101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:46.612386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:46.612663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:46.621633 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:46.623988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54995c7a-7671-4249-a710-bf876da96d14 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:46.633200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1314/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:46.989344 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:46.990900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:47.004241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06593ee6-2b0e-4765-bc4c-53817af4fb7f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.008911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.009800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.010109 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.010383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] PATH_INFO: `/v3/projects/ddcbc1fbe336493aa7711a57c54b04b3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.011581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcbc1fbe336493aa7711a57c54b04b3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.014196 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.114357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcbc1fbe336493aa7711a57c54b04b3', 'request_id': 'req-c636738a-b7eb-48d5-95e5-19b13f7108d6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:47.120391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcbc1fbe336493aa7711a57c54b04b3', 'request_id': 'req-c636738a-b7eb-48d5-95e5-19b13f7108d6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:47.126706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcbc1fbe336493aa7711a57c54b04b3', 'request_id': 'req-c636738a-b7eb-48d5-95e5-19b13f7108d6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:47.199048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] The token cache is being invalidate because project ddcbc1fbe336493aa7711a57c54b04b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:47.199341 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:47.200010 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c636738a-b7eb-48d5-95e5-19b13f7108d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:47.201650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1326/2640] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:46 2022] DELETE /identity/v3/projects/ddcbc1fbe336493aa7711a57c54b04b3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:47.206353 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.206824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.207042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.224419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:47.225643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:47.284835 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1315/2641] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:47.292414 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.292705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.292983 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.311772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:47.312951 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:47.320644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1327/2642] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:47.324592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.334047 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad34a66-e74e-44f9-bc58-9be5b398d0b3 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.338558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.339191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.339495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.339764 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.340473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:47.340772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.342393 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.353746 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1316/2643] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:47.358263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.367201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1536b1-38e3-4c42-b766-924a447cc11e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.372383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.373014 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.373289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.373856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.374529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.376421 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.507497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1328/2644] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:47.511606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.522494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f51b-1817-43d7-ae7e-70bd34258a57 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.578875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.579457 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.579738 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.580012 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.580704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.582643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.688973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1317/2645] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:47.692940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.703621 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261da38-5762-478f-83e6-e417510ee8a5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.708177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.708813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.709095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.709364 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.710132 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.711697 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.721759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1329/2646] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:47.725355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.735161 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41114f14-951a-44ed-a985-e48028fbc515 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.739714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.740351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.740628 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.740900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.741674 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.743284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f52d-e6cd-4d5a-88d5-2e5954be65d5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.753566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1318/2647] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:47.757236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:47.768475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d196-a3f7-4bb2-8944-1b732f653a80 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:47.773189 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:47.774084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.774369 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.774642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] PATH_INFO: `/v3/projects/0229004608f9432bbbf6bd9bf8ae3a29/users/68c1ad5d1d0e4c2a9df8a5725b545240/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.788675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0229004608f9432bbbf6bd9bf8ae3a29, user_id=68c1ad5d1d0e4c2a9df8a5725b545240, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:47.791325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:47.850619 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1330/2648] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:47 2022] PUT /identity/v3/projects/0229004608f9432bbbf6bd9bf8ae3a29/users/68c1ad5d1d0e4c2a9df8a5725b545240/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:15:47.862743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:47.863032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:47.863311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:47.889648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] MFA Rules not processed for user `68c1ad5d1d0e4c2a9df8a5725b545240`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:47.890943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:47.951521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1319/2649] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:47.955962 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.014060 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c52a9-cb2f-438e-be1d-b9b7c65cd1d9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.018543 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.019177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.019454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.019726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.020393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.022322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.085615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1331/2650] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:47 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:48.089671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.100143 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb975d-b3b2-46e8-b0a3-2747befe4f37 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.156340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.156930 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.157215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.157527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.158250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.160215 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.257121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1320/2651] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:48 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:15:48.261573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.271641 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac88b7-f549-4c7a-beb4-2aff93fa68ba admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.276285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.276937 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.277198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.286044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.286044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.286044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.290254 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1332/2652] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:48.294277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.304089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a07fe-af54-4047-9e95-4b75ee34c2c0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.308690 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.310094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.310371 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.310643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] PATH_INFO: `/v3/projects/7a1d9889dcfa48b3ab048f293d098162/users/d8e7ad89533b4769922d99f8241c1197/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.324673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d9889dcfa48b3ab048f293d098162, user_id=d8e7ad89533b4769922d99f8241c1197, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.327998 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.399402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1321/2653] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:48 2022] PUT /identity/v3/projects/7a1d9889dcfa48b3ab048f293d098162/users/d8e7ad89533b4769922d99f8241c1197/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:48.403372 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.416597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d985954-2db8-4ece-9719-4e79cf577ddc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.468836 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.469602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.469889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.470164 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.470879 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.472452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8950-62d7-453e-a982-a1f54cafa27e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.481930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1333/2654] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:48.486229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.496164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de36ab-e87b-4bb5-9426-ef670d5dbb2d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.501401 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.502291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.502566 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.502837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] PATH_INFO: `/v3/projects/7a1d9889dcfa48b3ab048f293d098162/users/d8e7ad89533b4769922d99f8241c1197/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.504778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d9889dcfa48b3ab048f293d098162, user_id=d8e7ad89533b4769922d99f8241c1197, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.507422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.517963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1322/2655] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:48 2022] PUT /identity/v3/projects/7a1d9889dcfa48b3ab048f293d098162/users/d8e7ad89533b4769922d99f8241c1197/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:48.528173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.528705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.528705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.554519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] MFA Rules not processed for user `d8e7ad89533b4769922d99f8241c1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:48.555753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:48.621156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1334/2656] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:48.632940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.634670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:48.689991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a91c-f7e8-451d-a8c0-f34ca2b113b3 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.693733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.694379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.694662 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.694940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.705311 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.706842 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e3bf-232d-4d40-b1e0-269886d5c26b service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.716583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1323/2657] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:48.744650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:48.804690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda231dd-20b7-4ad5-8bf3-c27f51813170 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:48.809314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:48.810692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:48.810997 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:48.811269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] PATH_INFO: `/v3/users/68c1ad5d1d0e4c2a9df8a5725b545240` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:48.812466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c1ad5d1d0e4c2a9df8a5725b545240)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:48.814443 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:48.997780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c1ad5d1d0e4c2a9df8a5725b545240'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.119535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c1ad5d1d0e4c2a9df8a5725b545240'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.133913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c1ad5d1d0e4c2a9df8a5725b545240'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.134775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c1ad5d1d0e4c2a9df8a5725b545240'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.142680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c1ad5d1d0e4c2a9df8a5725b545240'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.152745 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1335/2658] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:48 2022] DELETE /identity/v3/users/68c1ad5d1d0e4c2a9df8a5725b545240 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:49.155380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:49.155885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:49.156242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:49.174865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:49.176144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:49.233761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1324/2659] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:15:49.249277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:49.249277 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:49.308318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b97af-cd98-4209-b9d4-2a1992abdcf8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:49.312901 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:49.313663 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:49.314040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:49.314423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:49.324187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:49.326431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:49.336668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1336/2660] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:49.738759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:49.740241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:49.753647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c80c11-3edb-4f58-bb18-7ca44b8ff269 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:49.758595 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:49.759561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:49.759839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:49.760111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] PATH_INFO: `/v3/projects/0229004608f9432bbbf6bd9bf8ae3a29` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:49.761856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0229004608f9432bbbf6bd9bf8ae3a29)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:49.764018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:49.845926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0229004608f9432bbbf6bd9bf8ae3a29', 'request_id': 'req-b9ae96ba-58b2-4fce-9496-6437ab20b371'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.852190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0229004608f9432bbbf6bd9bf8ae3a29', 'request_id': 'req-b9ae96ba-58b2-4fce-9496-6437ab20b371'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.858182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0229004608f9432bbbf6bd9bf8ae3a29', 'request_id': 'req-b9ae96ba-58b2-4fce-9496-6437ab20b371'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.926610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] The token cache is being invalidate because project 0229004608f9432bbbf6bd9bf8ae3a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:49.926999 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.927538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:49.929187 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1325/2661] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:49 2022] DELETE /identity/v3/projects/0229004608f9432bbbf6bd9bf8ae3a29 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:49.933218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:49.943521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d4bed-aca8-4f87-8d1e-7948e079303d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:50.000213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:50.001086 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:50.001373 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:50.001682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] PATH_INFO: `/v3/users/d8e7ad89533b4769922d99f8241c1197` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:50.002885 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e7ad89533b4769922d99f8241c1197)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:50.004807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:50.203774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e7ad89533b4769922d99f8241c1197'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:50.288423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e7ad89533b4769922d99f8241c1197'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:50.300654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e7ad89533b4769922d99f8241c1197'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:50.302395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e7ad89533b4769922d99f8241c1197'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:50.308022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-19ac4e28-3a93-4add-9ac7-b44072e87fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e7ad89533b4769922d99f8241c1197'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:50.314598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1337/2662] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:15:49 2022] DELETE /identity/v3/users/d8e7ad89533b4769922d99f8241c1197 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:50.726344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:50.731290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:50.741364 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae96ba-58b2-4fce-9496-6437ab20b371 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:50.797102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:50.797927 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:50.798207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:50.798479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] PATH_INFO: `/v3/projects/7a1d9889dcfa48b3ab048f293d098162` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:50.799642 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1d9889dcfa48b3ab048f293d098162)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:50.801585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.039695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1d9889dcfa48b3ab048f293d098162', 'request_id': 'req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:51.046083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1d9889dcfa48b3ab048f293d098162', 'request_id': 'req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:51.051584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1d9889dcfa48b3ab048f293d098162', 'request_id': 'req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:51.113669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] The token cache is being invalidate because project 7a1d9889dcfa48b3ab048f293d098162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:15:51.113962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:51.114593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-d67dcad6-f4e6-41ba-b7b2-f92c4c8f0d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:15:51.116191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1326/2663] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:15:50 2022] DELETE /identity/v3/projects/7a1d9889dcfa48b3ab048f293d098162 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:51.121220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.121719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.121994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.140585 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:51.141939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:51.200430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1338/2664] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:51.208177 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.208576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.208776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.226970 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:51.228154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:51.235872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1327/2665] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:51.240007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.250223 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820eba5-ac67-4952-9979-2dc33f8c983b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.254986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.255620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.255900 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.256174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.256882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:15:51.257183 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.258788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.270516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1339/2666] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:15:51.274554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.283429 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711daa36-1bb2-4084-a03d-25beeb1bde7c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.288321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.288964 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.289248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.289563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.290250 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.292133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.372981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1328/2667] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:51.377502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.388235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded6ed-17cb-4ece-9b86-2dc395766d05 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.442407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.443074 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.443357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.443632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.444327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.446269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.514602 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1340/2668] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:51.518695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.528602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6714-51a4-4c4b-8271-2a4e9b299bc6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.533128 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.533810 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.534091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.534369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.535085 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.536737 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.546722 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1329/2669] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:51.550672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.561022 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99e8b-311c-46c1-b006-b936a7857d0f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.565670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.566337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.566631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.566910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.567630 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.569250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e4029-6a9d-4b40-b152-cce8b8ef0236 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.579539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1341/2670] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:51.583496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.592865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff0db-db57-4c6c-a5b8-527b555ec0f9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.597363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.598249 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.598541 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.598795 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] PATH_INFO: `/v3/projects/fad1f4ed90054aaea5a86361c88b924f/users/620afb7b29df4614babf6d9d15269382/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.612848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad1f4ed90054aaea5a86361c88b924f, user_id=620afb7b29df4614babf6d9d15269382, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.615486 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.682709 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1330/2671] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:51 2022] PUT /identity/v3/projects/fad1f4ed90054aaea5a86361c88b924f/users/620afb7b29df4614babf6d9d15269382/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:51.694051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.694375 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.694682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.721948 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] MFA Rules not processed for user `620afb7b29df4614babf6d9d15269382`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:51.723269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:51.784815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1342/2672] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:51.789244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.849940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340f63a-032a-4797-9583-888492c2db44 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:51.854498 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:51.855137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:51.855414 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:51.855683 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:51.856370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:51.858300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:51.943427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1331/2673] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:51.947517 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:51.958640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4d7e-ab5c-4750-a9dc-ed248c020f8a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.014898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.015577 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.015862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.016140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.016830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.018774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.107924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1343/2674] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:15:51 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:15:52.111773 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.121729 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c738e-1d09-4972-9b3c-49dfa1eccf38 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.126958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.127596 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.128065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.128229 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.128882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.130487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.140673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1332/2675] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:52.144597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.154366 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ad32-9bda-45de-8d6d-9a7ed90bd955 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.158993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.159853 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.160135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.160407 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] PATH_INFO: `/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a/users/49f472a7a3bf4495a0e3dfd729f95b1e/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.174502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ac7e174354a23b55cb8e45ab54d6a, user_id=49f472a7a3bf4495a0e3dfd729f95b1e, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.177143 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.242982 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1344/2676] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:52 2022] PUT /identity/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a/users/49f472a7a3bf4495a0e3dfd729f95b1e/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:52.247441 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.257872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24940-944b-4f4a-b8d0-7d693e5dcb32 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.312299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.312969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.313255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.313573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.314310 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.315910 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325f1c-0540-492f-9d89-54ed0857ab5d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.333565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1333/2677] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:15:52.334715 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.350185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a697c3-02d2-4beb-8896-a5942eec6052 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.357708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.358638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.358877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.359141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] PATH_INFO: `/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a/users/49f472a7a3bf4495a0e3dfd729f95b1e/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.361136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ac7e174354a23b55cb8e45ab54d6a, user_id=49f472a7a3bf4495a0e3dfd729f95b1e, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.363823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.374794 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1345/2678] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:15:52 2022] PUT /identity/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a/users/49f472a7a3bf4495a0e3dfd729f95b1e/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:15:52.385165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.385502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.385790 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.411524 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] MFA Rules not processed for user `49f472a7a3bf4495a0e3dfd729f95b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:15:52.412699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:52.478209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1334/2679] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:15:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:15:52.490141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.491864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:15:52.547179 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a483a-b22b-464a-905d-6ab90b7c8743 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.550796 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.551424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.551707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.551979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.561418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.562869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.572111 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1346/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:15:52.784981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:15:52.794890 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823a2e-70cd-4cc7-b0cd-345df6488015 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:15:52.798458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:15:52.799086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:15:52.799365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:15:52.799636 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:15:52.851928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:15:52.853361 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21f2a-092d-496c-9dc5-d2ef4dc2144e service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:15:52.862623 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1335/2681] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:15:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:02.355610 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:02.417398 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef4156-0450-410d-9f53-391632901534 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:02.422539 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:02.423388 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:02.423668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:02.423938 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] PATH_INFO: `/v3/users/620afb7b29df4614babf6d9d15269382` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:02.425379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620afb7b29df4614babf6d9d15269382)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:02.427046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:02.603191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620afb7b29df4614babf6d9d15269382'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:02.680420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620afb7b29df4614babf6d9d15269382'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:02.694259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620afb7b29df4614babf6d9d15269382'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:02.695073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620afb7b29df4614babf6d9d15269382'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:02.703139 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620afb7b29df4614babf6d9d15269382'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:02.710624 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1347/2682] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:02 2022] DELETE /identity/v3/users/620afb7b29df4614babf6d9d15269382 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:02.714917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f47ca-49bd-470f-9706-a666f60147db None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:02.715375 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f47ca-49bd-470f-9706-a666f60147db None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:02.715469 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f47ca-49bd-470f-9706-a666f60147db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:02.734485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-479f47ca-49bd-470f-9706-a666f60147db None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:02.735678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-479f47ca-49bd-470f-9706-a666f60147db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:02.795299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1336/2683] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:02.805088 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:02.806520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:02.869971 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3214-0c51-453e-a664-11b9e4a33b25 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:02.877692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:02.878348 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:02.878631 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:02.878959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:02.889922 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:02.891580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:02.901798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1348/2684] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:03.328865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f47ca-49bd-470f-9706-a666f60147db None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:03.330365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-479f47ca-49bd-470f-9706-a666f60147db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:03.343094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f47ca-49bd-470f-9706-a666f60147db None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:03.348716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:03.350209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:03.350495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:03.350768 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] PATH_INFO: `/v3/projects/fad1f4ed90054aaea5a86361c88b924f` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:03.352211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad1f4ed90054aaea5a86361c88b924f)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:03.354241 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:03.468345 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad1f4ed90054aaea5a86361c88b924f', 'request_id': 'req-96605fd2-fb43-405a-9536-2eb41a3258d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.474357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad1f4ed90054aaea5a86361c88b924f', 'request_id': 'req-96605fd2-fb43-405a-9536-2eb41a3258d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.479675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad1f4ed90054aaea5a86361c88b924f', 'request_id': 'req-96605fd2-fb43-405a-9536-2eb41a3258d6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.547428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] The token cache is being invalidate because project fad1f4ed90054aaea5a86361c88b924f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:03.547743 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.548343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.549882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1337/2685] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:03 2022] DELETE /identity/v3/projects/fad1f4ed90054aaea5a86361c88b924f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:03.553931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:03.563821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881482-1fcb-4014-8347-9e14e51f470d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:03.619339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:03.620211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:03.620495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:03.620768 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] PATH_INFO: `/v3/users/49f472a7a3bf4495a0e3dfd729f95b1e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:03.622037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f472a7a3bf4495a0e3dfd729f95b1e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:03.624709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:03.880526 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f472a7a3bf4495a0e3dfd729f95b1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.963739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f472a7a3bf4495a0e3dfd729f95b1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.976981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f472a7a3bf4495a0e3dfd729f95b1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.977809 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f472a7a3bf4495a0e3dfd729f95b1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.986691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a4e66cc3-3576-4a5a-be0e-c2fdb0d6e35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f472a7a3bf4495a0e3dfd729f95b1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:03.992751 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1349/2686] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:03 2022] DELETE /identity/v3/users/49f472a7a3bf4495a0e3dfd729f95b1e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:04.454089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:04.455521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:04.470586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fd2-fb43-405a-9536-2eb41a3258d6 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:04.525555 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:04.526399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:04.526678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:04.526946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] PATH_INFO: `/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:04.528109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ac7e174354a23b55cb8e45ab54d6a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:04.530637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:04.633664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ac7e174354a23b55cb8e45ab54d6a', 'request_id': 'req-ed5a2741-1325-4e85-af01-a25f4a8fa690'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:04.640134 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ac7e174354a23b55cb8e45ab54d6a', 'request_id': 'req-ed5a2741-1325-4e85-af01-a25f4a8fa690'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:04.645275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ac7e174354a23b55cb8e45ab54d6a', 'request_id': 'req-ed5a2741-1325-4e85-af01-a25f4a8fa690'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:04.717425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] The token cache is being invalidate because project cc2ac7e174354a23b55cb8e45ab54d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:04.717719 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:04.718328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ed5a2741-1325-4e85-af01-a25f4a8fa690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:04.719929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1338/2687] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:04 2022] DELETE /identity/v3/projects/cc2ac7e174354a23b55cb8e45ab54d6a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:04.725776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:04.726270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:04.726270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:04.744187 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:04.745359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:04.801418 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1350/2688] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:04.809297 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:04.809613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:04.810398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:04.828551 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:04.829765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:04.837390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1339/2689] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:04.841482 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:04.850818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ebaa-47c4-482f-ade0-fac6324b4ca8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:04.855432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:04.856065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:04.856346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:04.856620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:04.857322 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:04.857651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:04.859225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:04.870324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1351/2690] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:16:04.875281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:04.884550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33f96d-41ec-46ea-ac4d-e621324e306f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:04.890292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:04.891273 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:04.891557 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:04.891833 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:04.892708 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:04.894687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.005492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1340/2691] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:04 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:05.009557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.019867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea84a4-b09e-44e8-b526-72e5d3eb9cd4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.072767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.073413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.073726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.073998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.074669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.077214 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.209802 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1352/2692] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:05 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:05.215285 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.225617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ded5f-6a98-433f-8830-dc007a58f521 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.230191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.230839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.231117 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.231388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.232606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.234231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.247291 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1341/2693] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:05.249119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.259453 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58659eb5-2285-4674-acc2-2f08b4169ecb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.264198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.264846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.265127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.265401 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.266155 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.267770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebd84-cd41-47cb-89f5-d9152211da91 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.277834 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1353/2694] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:05.282018 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.291584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637f689-5d86-4ade-9f31-697046db3e4c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.296834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.297739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.298017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.298288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] PATH_INFO: `/v3/projects/8c3f095357694e908c18e3765e53e59d/users/3bb37ebd57b54c298ef00a913d1f205e/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.317467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3f095357694e908c18e3765e53e59d, user_id=3bb37ebd57b54c298ef00a913d1f205e, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.320173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.403753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1342/2695] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:05 2022] PUT /identity/v3/projects/8c3f095357694e908c18e3765e53e59d/users/3bb37ebd57b54c298ef00a913d1f205e/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:05.414013 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.414303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.414611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.441114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] MFA Rules not processed for user `3bb37ebd57b54c298ef00a913d1f205e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:05.442355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:05.503386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1354/2696] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:05.507987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.564993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c0f6-1a1c-40f6-b51d-49512d5ad006 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.569841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.570487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.570763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.571034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.571716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.573688 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.661994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1343/2697] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:05 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:05.666006 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.677025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0233-c100-4a37-a042-4418aef73912 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.730559 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.731209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.731486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.731757 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.733085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.735008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.832805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1355/2698] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:05 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:05.836794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.847474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f365ce0-6c23-4db9-a8e9-ad9413794d5c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.851951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.852586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.852865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.853138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.853885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.855503 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:05.866263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1344/2699] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:05.870363 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:05.880313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d599-1fae-4a1a-b80f-f9c7232e237e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:05.884792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:05.885729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:05.886011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:05.886283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] PATH_INFO: `/v3/projects/b7ef474d410242f691f2d0e510685db7/users/ab5a76bf6bac4903b6b59686d7b8b5a4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:05.901473 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ef474d410242f691f2d0e510685db7, user_id=ab5a76bf6bac4903b6b59686d7b8b5a4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:05.904761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:06.038121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1356/2700] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:05 2022] PUT /identity/v3/projects/b7ef474d410242f691f2d0e510685db7/users/ab5a76bf6bac4903b6b59686d7b8b5a4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:06.042148 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:06.051802 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206edb0-28dd-4b4c-9efd-5827f23bf98f admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:06.105038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:06.105731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:06.106011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:06.106284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:06.107008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:06.108592 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eccba-a27a-4d62-9651-737341db2715 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:06.117926 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1345/2701] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:06.121992 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:06.132448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86dfad-41af-476e-9e27-420c20892d4c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:06.137033 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:06.137934 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:06.138731 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:06.139001 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] PATH_INFO: `/v3/projects/b7ef474d410242f691f2d0e510685db7/users/ab5a76bf6bac4903b6b59686d7b8b5a4/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:06.140940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ef474d410242f691f2d0e510685db7, user_id=ab5a76bf6bac4903b6b59686d7b8b5a4, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:06.143579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:06.154848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1357/2702] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:06 2022] PUT /identity/v3/projects/b7ef474d410242f691f2d0e510685db7/users/ab5a76bf6bac4903b6b59686d7b8b5a4/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:06.164914 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:06.165200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:06.165496 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:06.190794 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] MFA Rules not processed for user `ab5a76bf6bac4903b6b59686d7b8b5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:06.191972 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:06.256611 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1346/2703] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:06.267819 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:06.269503 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:06.323688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245b0d-7704-4f1c-86a9-20cab8c1ef6b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:06.327833 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:06.328455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:06.328732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:06.329000 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:06.391838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:06.393275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:06.402289 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1358/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:15.927960 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:15.929468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:15.984682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192c0cb-a8a5-4226-93c0-6aa69ac61d07 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:15.988553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:15.989186 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:15.989501 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:15.989774 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:15.991622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:16.002230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:16.004057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:16.012552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1347/2705] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:17.728082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:17.729848 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:17.800065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca07086-2709-412c-8b29-0ce3ab74cbe4 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:17.805151 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:17.805876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:17.806159 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:17.806438 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:17.808219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:17.820634 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:17.822302 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:17.843808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1359/2706] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:24.261261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:24.270246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4249e8-8455-4da4-98eb-8a0ebf03932b service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:24.273801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:24.274421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:24.274696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:24.274963 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:24.284096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:24.285538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34719b-17f5-47e6-88da-25fcf09e056d service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:24.294560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1348/2707] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:31.362327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:31.363824 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:31.429931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94c6e-3a5c-43fa-afc7-46a7c946bb13 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:31.434680 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:31.435456 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:31.435733 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:31.436007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] PATH_INFO: `/v3/users/02c182726caf41e3bcb3d0617b7ffd66` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:31.437177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c182726caf41e3bcb3d0617b7ffd66)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:31.439166 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:31.630083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c182726caf41e3bcb3d0617b7ffd66'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:31.702021 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c182726caf41e3bcb3d0617b7ffd66'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:31.714773 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c182726caf41e3bcb3d0617b7ffd66'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:31.715448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c182726caf41e3bcb3d0617b7ffd66'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:31.722035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c182726caf41e3bcb3d0617b7ffd66'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:31.728011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1360/2708] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:31 2022] DELETE /identity/v3/users/02c182726caf41e3bcb3d0617b7ffd66 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:31.732673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:31.733157 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:31.733280 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:31.750432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:31.752641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:31.815189 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1349/2709] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:31.836898 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:31.838692 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:31.895895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883a68-ebca-4a16-a9a6-2d88ea040994 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:31.899548 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:31.900207 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:31.900493 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:31.900772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:31.909850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:31.911476 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:31.920711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1361/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:32.340988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:32.342436 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:32.355027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52a1d-0552-4cd5-97c2-2c7ca3d182ca None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:32.360279 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:32.361812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:32.362116 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:32.362714 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] PATH_INFO: `/v3/projects/e3ea9e2df9a941b098ea0c819d605e74` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:32.363848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea9e2df9a941b098ea0c819d605e74)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:32.365851 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:32.500696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea9e2df9a941b098ea0c819d605e74', 'request_id': 'req-9f314e1f-36b4-41bb-922d-af1d549e8007'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.507641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea9e2df9a941b098ea0c819d605e74', 'request_id': 'req-9f314e1f-36b4-41bb-922d-af1d549e8007'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.513825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea9e2df9a941b098ea0c819d605e74', 'request_id': 'req-9f314e1f-36b4-41bb-922d-af1d549e8007'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.584878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] The token cache is being invalidate because project e3ea9e2df9a941b098ea0c819d605e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:32.585219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.585814 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.587350 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1350/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:32 2022] DELETE /identity/v3/projects/e3ea9e2df9a941b098ea0c819d605e74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:32.591452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:32.601488 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad8d41-ef7c-48cb-b6c7-6dd18d65aa1d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:32.655530 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:32.656404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:32.656688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:32.656958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] PATH_INFO: `/v3/users/22e5c334e0cd46d59aa220f689d5a51a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:32.658689 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e5c334e0cd46d59aa220f689d5a51a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:32.660628 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:32.853327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e5c334e0cd46d59aa220f689d5a51a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.927830 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e5c334e0cd46d59aa220f689d5a51a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.940324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e5c334e0cd46d59aa220f689d5a51a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.941039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e5c334e0cd46d59aa220f689d5a51a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.947816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c58e7ca6-d028-482f-8d26-41bb9db71c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e5c334e0cd46d59aa220f689d5a51a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:32.953665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1362/2712] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:32 2022] DELETE /identity/v3/users/22e5c334e0cd46d59aa220f689d5a51a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:33.384284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:33.385791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:33.398834 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314e1f-36b4-41bb-922d-af1d549e8007 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:33.455175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:33.456038 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:33.456316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:33.456585 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] PATH_INFO: `/v3/projects/ed3cb20ea19a4c549b5d532967c045ae` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:33.457772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3cb20ea19a4c549b5d532967c045ae)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:33.459654 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:33.582564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3cb20ea19a4c549b5d532967c045ae', 'request_id': 'req-9159e10a-6ef8-49c8-baf7-c5188ca59e65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:33.588476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3cb20ea19a4c549b5d532967c045ae', 'request_id': 'req-9159e10a-6ef8-49c8-baf7-c5188ca59e65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:33.594109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3cb20ea19a4c549b5d532967c045ae', 'request_id': 'req-9159e10a-6ef8-49c8-baf7-c5188ca59e65'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:33.687637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] The token cache is being invalidate because project ed3cb20ea19a4c549b5d532967c045ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:33.687924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:33.688548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9159e10a-6ef8-49c8-baf7-c5188ca59e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:33.690094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1351/2713] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:33 2022] DELETE /identity/v3/projects/ed3cb20ea19a4c549b5d532967c045ae => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:33.695436 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:33.695891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:33.696048 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:33.713713 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:33.714893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:33.771772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1363/2714] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:33.780650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:33.780975 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:33.781248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:33.800155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:33.801376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:33.809916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1352/2715] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:33.813156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:33.822869 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98ad84-4bcd-4b62-9f5c-eba3f34b64e8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:33.827431 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:33.828069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:33.828349 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:33.828622 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:33.829337 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:33.829827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:33.832653 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:33.844882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1364/2716] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:16:33.852077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:33.861175 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778205-8165-4da9-aa24-f1706feeb0af None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:33.865785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:33.866416 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:33.866695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:33.867061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:33.867744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:33.869641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:33.958203 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1353/2717] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:33 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:33.962404 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:33.972434 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae30cb-40bd-4d41-8115-429bf255e907 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.028283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.028946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.029225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.029540 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.030232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.034354 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.142910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1365/2718] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:33 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:34.147488 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.157770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a33f-694a-4d7c-8a19-b7d03bd1d2d8 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.162408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.163056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.163336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.163608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.164330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.165977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.176109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1354/2719] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:34.180120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.190724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e812-566f-4ec8-b1bb-9c04b4b1a46d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.195335 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.195979 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.196259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.196532 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.197241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.198915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cb87a-87e3-41b6-bb79-5f3b00e37eb5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.209113 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1366/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:34.213111 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.222877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253c57-22d7-420a-a020-008006f106d7 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.227782 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.228651 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.228932 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.229536 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] PATH_INFO: `/v3/projects/1afc1bea122642d99c1579bef2905ba1/users/b0e5da8edf7e46a994de0538dc5f7cff/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.243920 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afc1bea122642d99c1579bef2905ba1, user_id=b0e5da8edf7e46a994de0538dc5f7cff, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.246705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.345706 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1355/2721] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:34 2022] PUT /identity/v3/projects/1afc1bea122642d99c1579bef2905ba1/users/b0e5da8edf7e46a994de0538dc5f7cff/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:34.357136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.357767 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.358218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.389801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] MFA Rules not processed for user `b0e5da8edf7e46a994de0538dc5f7cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:34.391049 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:34.457056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1367/2722] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:34.461597 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.523146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7237-9f0d-479f-b831-e3bdede6e68d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.528110 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.528753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.529031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.529302 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.530027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.531905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.689146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1356/2723] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:34 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:34.693269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.703758 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab980-7315-406d-84cc-6bcf81bd7e32 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.758205 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.758868 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.759147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.759416 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.760092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.762108 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.865944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1368/2724] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:34 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:34.870251 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.880510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc58a8c-a0f4-4f9e-b417-51b2f5b8df2b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.885064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.885731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.886009 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.886305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.887028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.888609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:34.898856 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1357/2725] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:16:34.902996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:34.913305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4bfe-b267-4f4c-b8f6-bbdbbc04fa9c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:34.918102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:34.918967 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:34.919246 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:34.923342 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] PATH_INFO: `/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d/users/90741c85cba44782a9566c3b4dc44bbb/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:34.934427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8f143908c6418eb20fe4d6b2a7d11d, user_id=90741c85cba44782a9566c3b4dc44bbb, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:34.937063 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.025536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1369/2726] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:34 2022] PUT /identity/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d/users/90741c85cba44782a9566c3b4dc44bbb/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:35.029792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.040396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f139-77e5-4328-8a1a-7cfc9cc7a4aa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.095863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.097096 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.097382 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.097676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.098399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.099974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61c94-7ae5-43bb-9a48-b18e53c19821 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.109479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1358/2727] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:35.113688 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.123636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcaa85-e5f5-4e0c-bb68-7a51c5853ed0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.128475 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.129333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.129644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.129919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] PATH_INFO: `/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d/users/90741c85cba44782a9566c3b4dc44bbb/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.131875 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8f143908c6418eb20fe4d6b2a7d11d, user_id=90741c85cba44782a9566c3b4dc44bbb, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.134510 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.144807 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1370/2728] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:35 2022] PUT /identity/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d/users/90741c85cba44782a9566c3b4dc44bbb/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:35.154695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.154983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.155262 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.181191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] MFA Rules not processed for user `90741c85cba44782a9566c3b4dc44bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:35.182459 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.248091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1359/2729] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:35.261321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.263263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.320675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74238-5412-4bdd-964d-890a25065e13 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.324351 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.324980 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.325259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.325566 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.334959 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.336383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.345777 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1371/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:35.390824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.392211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.454263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.456271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.457947 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9097aa-0ada-4a7e-ab25-5f08300587cc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.462478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.463354 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.463635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.463911 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] PATH_INFO: `/v3/users/3bb37ebd57b54c298ef00a913d1f205e` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.465114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb37ebd57b54c298ef00a913d1f205e)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.467073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.468422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5988a1-ea09-466f-9d94-ff56926d86e8 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.472243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.472883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.473162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.473455 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.530788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.532276 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c4956-62a2-4bda-80bc-653a41ee99eb service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.541220 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1372/2731] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:35.676883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb37ebd57b54c298ef00a913d1f205e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:35.794052 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb37ebd57b54c298ef00a913d1f205e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:35.806613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb37ebd57b54c298ef00a913d1f205e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:35.807283 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb37ebd57b54c298ef00a913d1f205e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:35.808073 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb37ebd57b54c298ef00a913d1f205e'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:35.820530 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1360/2732] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:35 2022] DELETE /identity/v3/users/3bb37ebd57b54c298ef00a913d1f205e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:35.825071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.825555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.831642 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.842682 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:35.843862 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.902467 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1373/2733] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:35.912316 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:35.913748 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:35.968922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c731a-a979-4c9f-9f5f-2ef264daed4c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:35.972567 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:35.973188 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:35.973491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:35.973767 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:35.982522 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:35.987808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:35.993699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1361/2734] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:36.340953 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:36.342459 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:36.354943 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438b6d-c843-4179-81f3-ab99dc8f09fa None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:36.361762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:36.363209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:36.363491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:36.363764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] PATH_INFO: `/v3/users/b8fa805361554c05a54368e41b46f61c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:36.365065 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fa805361554c05a54368e41b46f61c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:36.367029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:36.479510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:36.480951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:36.494643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdc47c-79b5-4843-8dff-567377529d96 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:36.499408 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:36.500325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:36.500602 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:36.500876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] PATH_INFO: `/v3/projects/8c3f095357694e908c18e3765e53e59d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:36.502171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3f095357694e908c18e3765e53e59d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:36.504568 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:36.657066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fa805361554c05a54368e41b46f61c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.661715 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3f095357694e908c18e3765e53e59d', 'request_id': 'req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.667841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3f095357694e908c18e3765e53e59d', 'request_id': 'req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.673049 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3f095357694e908c18e3765e53e59d', 'request_id': 'req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.745486 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fa805361554c05a54368e41b46f61c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.758066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fa805361554c05a54368e41b46f61c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.758753 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fa805361554c05a54368e41b46f61c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.765427 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-53525df8-2bd5-4426-b0d6-835d813e3f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fa805361554c05a54368e41b46f61c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.772091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1374/2735] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:36 2022] DELETE /identity/v3/users/b8fa805361554c05a54368e41b46f61c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:36.776618 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:36.777039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:36.777393 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:36.795457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:36.799636 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:36.822527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] The token cache is being invalidate because project 8c3f095357694e908c18e3765e53e59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:36.822807 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.823731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:36.825625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1362/2736] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:36 2022] DELETE /identity/v3/projects/8c3f095357694e908c18e3765e53e59d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:36.831281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:36.832731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:36.860917 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1375/2737] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:36.874225 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:36.875998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:36.901326 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8aa38-0096-4914-aeac-6c56ae6c0fb9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:36.903427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:36.904312 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:36.904593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:36.904865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] PATH_INFO: `/v3/users/ab5a76bf6bac4903b6b59686d7b8b5a4` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:36.906100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5a76bf6bac4903b6b59686d7b8b5a4)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:36.908017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:36.932082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af821e-beb5-4bac-8e6b-8fe4be1fb48a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:36.935818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:36.941504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:36.941504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:36.941504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:36.946439 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:36.947867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:36.957707 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1376/2738] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:37.207139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5a76bf6bac4903b6b59686d7b8b5a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.265397 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5a76bf6bac4903b6b59686d7b8b5a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.279109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5a76bf6bac4903b6b59686d7b8b5a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.279789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5a76bf6bac4903b6b59686d7b8b5a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.280439 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-554d9d9f-4716-47ae-a324-9a35a7312770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5a76bf6bac4903b6b59686d7b8b5a4'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.292581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1363/2739] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:36 2022] DELETE /identity/v3/users/ab5a76bf6bac4903b6b59686d7b8b5a4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:37.393253 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:37.394858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:37.429726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e356c-1e88-415e-b398-4080c03cb0f1 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:37.487385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:37.488267 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.488547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.488821 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] PATH_INFO: `/v3/projects/f717292fc4ad4e8da1192b932f4de751` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.490092 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f717292fc4ad4e8da1192b932f4de751)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:37.492050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:37.614299 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f717292fc4ad4e8da1192b932f4de751', 'request_id': 'req-cbcc0601-889a-46d5-9de1-de2ffee62106'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.624560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f717292fc4ad4e8da1192b932f4de751', 'request_id': 'req-cbcc0601-889a-46d5-9de1-de2ffee62106'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.632327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f717292fc4ad4e8da1192b932f4de751', 'request_id': 'req-cbcc0601-889a-46d5-9de1-de2ffee62106'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.704945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] The token cache is being invalidate because project f717292fc4ad4e8da1192b932f4de751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:37.705629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.707230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cbcc0601-889a-46d5-9de1-de2ffee62106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.709100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1377/2740] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:37 2022] DELETE /identity/v3/projects/f717292fc4ad4e8da1192b932f4de751 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:37.714246 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.714770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.714917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.734244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:37.734510 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:37.793269 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1364/2741] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:37.801755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.801755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.802097 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.802388 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:37.804200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:37.818191 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a173e2-f5c9-4d3d-9db4-bc628bfac990 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:37.823472 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:37.824663 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.824957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.825234 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] PATH_INFO: `/v3/projects/b7ef474d410242f691f2d0e510685db7` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.826589 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ef474d410242f691f2d0e510685db7)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:37.828961 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:37.841079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:37.842314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:37.851382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1378/2742] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:37.868002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:37.871531 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdd540-050e-4843-889a-b5298fe705b5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:37.876345 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:37.877028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.877314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.878157 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.878946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:37.879251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:37.880847 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:37.892734 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1379/2743] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 06:16:37.897666 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:37.907579 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159269e-b878-43b1-8bc8-b09e6d8c2bae admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:37.912360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:37.913054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:37.917248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:37.917248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:37.917248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:37.917248 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:37.982444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ef474d410242f691f2d0e510685db7', 'request_id': 'req-31e5cdc2-db12-471a-bd88-6e299de0f245'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.988934 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ef474d410242f691f2d0e510685db7', 'request_id': 'req-31e5cdc2-db12-471a-bd88-6e299de0f245'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.994765 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ef474d410242f691f2d0e510685db7', 'request_id': 'req-31e5cdc2-db12-471a-bd88-6e299de0f245'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:37.998904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1380/2744] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:37 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:38.003581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.063515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb379fa-8869-441a-8e00-cd0f02aeb028 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.068912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.069601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.072333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.072333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.072333 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.072711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.101991 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] The token cache is being invalidate because project b7ef474d410242f691f2d0e510685db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:38.102300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:38.103034 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-31e5cdc2-db12-471a-bd88-6e299de0f245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:38.104603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1365/2745] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:37 2022] DELETE /identity/v3/projects/b7ef474d410242f691f2d0e510685db7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:38.110418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e27f3-334e-4586-9695-e430d97bf3f9 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.110703 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e27f3-334e-4586-9695-e430d97bf3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.110977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e27f3-334e-4586-9695-e430d97bf3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.130103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d30e27f3-334e-4586-9695-e430d97bf3f9 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:38.131100 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d30e27f3-334e-4586-9695-e430d97bf3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:38.142645 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1366/2746] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:38.154468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.154754 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.155028 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.174223 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:38.176008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:38.185359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1367/2747] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:38.192738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1381/2748] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/users => generated 282 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:38.193919 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.194070 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.195290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:38.204011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88af7-0acf-472a-b686-e4aaaf06b170 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.206954 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f936-a8b9-44ee-9b99-7fd4b37b5f06 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.209008 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.209759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.210234 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.210587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.211361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:38.211749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.211956 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.212669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.213025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.213475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.214288 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.214709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.216006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.226398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1368/2749] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:38.228776 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1382/2750] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:16:38.236344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.236480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.246463 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d9b8-8548-4234-981c-5a058283726b admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.246611 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52ddf-6b98-4073-a383-1dfa21f2ecff admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.251198 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.251360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.251826 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.251938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.252106 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.252213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.252383 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.252481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.253659 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.253801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.255304 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.255542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.265599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1369/2751] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:16:38.276805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.286373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a21f2-a11a-4163-8565-a8a9b13bb6aa admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.290946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.291792 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.292071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.292343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] PATH_INFO: `/v3/projects/501356946b964130b2ad7518f91a030c/users/c79dc88dc1634ba5b51e1ca318f5439b/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.306863 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501356946b964130b2ad7518f91a030c, user_id=c79dc88dc1634ba5b51e1ca318f5439b, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.309514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d41ff-5fe9-4ca1-9907-ea02905432d4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.379072 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1383/2752] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:38.382914 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.411951 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1370/2753] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:38 2022] PUT /identity/v3/projects/501356946b964130b2ad7518f91a030c/users/c79dc88dc1634ba5b51e1ca318f5439b/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:38.423520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.423520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.423520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.447691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798414b6-b383-4a93-9478-96d4852aff57 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.451396 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] MFA Rules not processed for user `c79dc88dc1634ba5b51e1ca318f5439b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:38.452582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:38.503429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.504091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.504963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.504963 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.505288 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.507242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.515370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1371/2754] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:38.526718 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.528044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:38.582020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ed467-0ec0-4efc-8e0c-8ace9b328e7c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.585637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.586263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.586543 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.586816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.594730 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.596153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.605199 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1372/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:38.630346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1384/2756] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:38.635583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.663684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac710-6a08-4656-bb78-5b45d08b1e5c service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.675605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.677476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.677763 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.678067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.680581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.682483 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.696640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1373/2757] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:16:38.700441 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.712627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6300f88-3d57-4347-bdb3-50ef0deb9e18 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.719306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.719435 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.719810 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.720175 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.720975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.723245 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4165d6-168b-433c-b31a-639217d1eddc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.741301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1385/2758] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:16:38.745671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:38.758025 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea8b8a-7c56-48b7-921d-bb9dcfbbae7e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:38.762691 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:38.763634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.765547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.765547 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] PATH_INFO: `/v3/projects/8fcbe395931542d6859c1cb240c6da5a/users/80a6b2cfcf8b4c9f80b2cf1dbafaba3b/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.779417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcbe395931542d6859c1cb240c6da5a, user_id=80a6b2cfcf8b4c9f80b2cf1dbafaba3b, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:38.782171 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:38.900877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1374/2759] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:38 2022] PUT /identity/v3/projects/8fcbe395931542d6859c1cb240c6da5a/users/80a6b2cfcf8b4c9f80b2cf1dbafaba3b/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:38.913007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:38.913617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:38.913617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:38.945489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] MFA Rules not processed for user `80a6b2cfcf8b4c9f80b2cf1dbafaba3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:38.946714 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:39.010233 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1386/2760] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:39.021387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:39.023075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:39.079806 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c50880-6a93-46c2-b1f6-5ce48e6aeaf1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:39.083521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:39.084165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:39.084450 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:39.084728 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:39.093610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:39.095068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58134b37-80be-42c8-89ce-b12e31bf85d5 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:39.104816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1375/2761] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:39.124209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:39.187235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598021e9-a103-4fda-857b-ec0717f1dbb0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:39.191912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:39.192799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:39.193079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:39.193356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] PATH_INFO: `/v3/users/80a6b2cfcf8b4c9f80b2cf1dbafaba3b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:39.194617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a6b2cfcf8b4c9f80b2cf1dbafaba3b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:39.196535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:39.389359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a6b2cfcf8b4c9f80b2cf1dbafaba3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:39.454520 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a6b2cfcf8b4c9f80b2cf1dbafaba3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:39.467310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a6b2cfcf8b4c9f80b2cf1dbafaba3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:39.468019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a6b2cfcf8b4c9f80b2cf1dbafaba3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:39.475120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a6b2cfcf8b4c9f80b2cf1dbafaba3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:39.481096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1387/2762] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:39 2022] DELETE /identity/v3/users/80a6b2cfcf8b4c9f80b2cf1dbafaba3b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:39.485637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:39.486003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:39.486295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:39.504183 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:39.505485 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:39.564233 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1376/2763] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:39.573955 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:39.575355 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:39.631303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324d89-77a7-4e3e-bdfe-c5b25ef0d88b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:39.635118 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:39.635823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:39.636107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:39.636382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:39.646199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:39.647625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e00e0-3d85-4f93-87ac-543e106b041a service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:39.656695 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1388/2764] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:40.175716 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:40.177389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:40.190845 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc805b2-1269-43db-8996-73b3ff69a22f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:40.195500 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:40.196582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.196928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.197230 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] PATH_INFO: `/v3/projects/8fcbe395931542d6859c1cb240c6da5a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.198444 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcbe395931542d6859c1cb240c6da5a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:40.200400 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:40.410580 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcbe395931542d6859c1cb240c6da5a', 'request_id': 'req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:40.416761 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcbe395931542d6859c1cb240c6da5a', 'request_id': 'req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:40.422159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcbe395931542d6859c1cb240c6da5a', 'request_id': 'req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:40.528878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] The token cache is being invalidate because project 8fcbe395931542d6859c1cb240c6da5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:40.529167 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:40.533295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-6a33cd56-7065-45d1-9190-4bb1efc7f7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:40.533295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1377/2765] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:40 2022] DELETE /identity/v3/projects/8fcbe395931542d6859c1cb240c6da5a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:40.537592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.538082 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.538199 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.556135 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:40.562242 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:40.614420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1389/2766] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:40.630266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.630266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.630266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.641122 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:40.642373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:40.650132 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1378/2767] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:40.657056 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:40.667762 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a117-3c7d-4d6f-8d59-4f8e4427dc02 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:40.672403 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:40.673051 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.673334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.673652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.674361 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:40.675237 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:40.676927 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:40.690560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1390/2768] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:16:40.694559 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:40.703874 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbd960-b6a5-4418-bc5f-881f7e854fba None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:40.718007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:40.719121 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.719583 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.720031 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.725675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:40.728365 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:40.819827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:40.822360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:40.841489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1379/2769] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:40.845586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:40.904551 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca9c6e-9778-4d1c-a752-993483fcab3d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:40.908245 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401c1b-4dbe-40c8-a947-4f48f87ba0fe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:40.914032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:40.914731 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.918629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.918629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.918629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:40.918629 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:40.975474 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:40.976127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:40.976410 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:40.976706 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:40.978616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:40.990590 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:40.992191 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:40.995491 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1380/2770] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:40 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:41.001465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.004285 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1391/2771] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:41.014976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a719d-97d4-49a6-aa83-d3d8ffdce032 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.020780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.021519 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.021805 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.022087 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.023130 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.024478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.034876 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1381/2772] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 06:16:41.041721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.053429 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80e9f-545b-422d-994a-bfdd1970d7d7 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.059305 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.059994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.060296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.060573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.061307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.062972 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.073913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1392/2773] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:41.078200 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.088296 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c156c6-f750-463b-be76-7036aa030060 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.093020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.093924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.094211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.094489 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] PATH_INFO: `/v3/projects/39d8e0e9d69d4e34bdef54a917228f74/users/2f636f22e2a5414dbc455b74e509f529/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.109159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d8e0e9d69d4e34bdef54a917228f74, user_id=2f636f22e2a5414dbc455b74e509f529, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.112609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188b591-4bc9-455b-8555-895edc5c21a0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.159644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.165946 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:41.180193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337854-0ad5-4619-a372-47902a88b6de admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.184984 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.185910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.186190 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.186461 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] PATH_INFO: `/v3/users/b0e5da8edf7e46a994de0538dc5f7cff` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.187649 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e5da8edf7e46a994de0538dc5f7cff)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.189597 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.209332 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1382/2774] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:41 2022] PUT /identity/v3/projects/39d8e0e9d69d4e34bdef54a917228f74/users/2f636f22e2a5414dbc455b74e509f529/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:41.216094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.216379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.216676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.233062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:41.234255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:41.289848 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1383/2775] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:41.300067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.301418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:41.360001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dcdaa-dbb0-46fb-8f44-7d57adc105df None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.364107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.364789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.365062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.365333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.374780 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.376305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff574c-00f7-402e-bf14-92541160820c service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.387387 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1384/2776] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:41.414673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e5da8edf7e46a994de0538dc5f7cff'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:41.508437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e5da8edf7e46a994de0538dc5f7cff'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:41.521555 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e5da8edf7e46a994de0538dc5f7cff'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:41.522271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e5da8edf7e46a994de0538dc5f7cff'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:41.529571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e5da8edf7e46a994de0538dc5f7cff'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:41.536616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1393/2777] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:41 2022] DELETE /identity/v3/users/b0e5da8edf7e46a994de0538dc5f7cff => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:41.541042 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.541336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.541647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.560578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:41.561957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:41.632292 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1385/2778] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:41.641850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:41.643915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:41.701181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3772c-8597-4690-b17e-a62590723549 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:41.704800 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:41.705454 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:41.705766 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:41.706616 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:41.715549 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:41.717016 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:41.726863 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1394/2779] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:42.182667 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:42.184146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:42.195870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0157c-83c0-4231-8139-4ba00f5c785c None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:42.200637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:42.201448 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:42.201742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:42.202002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] PATH_INFO: `/v3/projects/1afc1bea122642d99c1579bef2905ba1` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:42.203190 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afc1bea122642d99c1579bef2905ba1)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:42.205248 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:42.314590 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afc1bea122642d99c1579bef2905ba1', 'request_id': 'req-3e843e50-c4e7-47e3-a194-b28e01fb9986'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.320912 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afc1bea122642d99c1579bef2905ba1', 'request_id': 'req-3e843e50-c4e7-47e3-a194-b28e01fb9986'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.326323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afc1bea122642d99c1579bef2905ba1', 'request_id': 'req-3e843e50-c4e7-47e3-a194-b28e01fb9986'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.402266 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] The token cache is being invalidate because project 1afc1bea122642d99c1579bef2905ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:42.402554 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.403270 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-3e843e50-c4e7-47e3-a194-b28e01fb9986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.404864 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1386/2780] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:42 2022] DELETE /identity/v3/projects/1afc1bea122642d99c1579bef2905ba1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:42.408725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:42.418744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e194-195f-4a3f-9f9d-62f20a1a5836 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:42.473534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:42.474422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:42.474705 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:42.474981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] PATH_INFO: `/v3/users/90741c85cba44782a9566c3b4dc44bbb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:42.476215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90741c85cba44782a9566c3b4dc44bbb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:42.478213 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:42.672813 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90741c85cba44782a9566c3b4dc44bbb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.765852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90741c85cba44782a9566c3b4dc44bbb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.780805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90741c85cba44782a9566c3b4dc44bbb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.781572 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90741c85cba44782a9566c3b4dc44bbb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.789107 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90741c85cba44782a9566c3b4dc44bbb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:42.795215 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1395/2781] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:42 2022] DELETE /identity/v3/users/90741c85cba44782a9566c3b4dc44bbb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:42.827213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:42.827581 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:42.827785 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:42.858593 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] MFA Rules not processed for user `2f636f22e2a5414dbc455b74e509f529`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:42.859797 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:42.935637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1387/2782] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:42.946604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:42.948029 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:43.006386 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13203568-0422-4e26-9be2-33223754d52d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.010017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.010658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.010939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.011235 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.022632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.026326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f68b1a-769a-4dca-b22a-603a92d5b987 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:43.034736 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1396/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:43.228016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:43.229502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:43.298756 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22657-1a2d-48e2-9c68-da031095c3ce None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.303458 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.304341 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.304614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.304883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] PATH_INFO: `/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.306061 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8f143908c6418eb20fe4d6b2a7d11d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.307937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:43.427438 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8f143908c6418eb20fe4d6b2a7d11d', 'request_id': 'req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:43.434917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8f143908c6418eb20fe4d6b2a7d11d', 'request_id': 'req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:43.438974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8f143908c6418eb20fe4d6b2a7d11d', 'request_id': 'req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:43.508969 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] The token cache is being invalidate because project 6d8f143908c6418eb20fe4d6b2a7d11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:43.509309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:43.509957 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5d4f8bba-b265-4f19-95e0-4bcd2dffd492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:43.511624 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1388/2784] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:43 2022] DELETE /identity/v3/projects/6d8f143908c6418eb20fe4d6b2a7d11d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:43.516598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.516895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.517171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.534623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:43.535805 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:43.595036 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1397/2785] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:43.603330 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a5672-16df-42da-bb96-e186706409dc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.603616 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a5672-16df-42da-bb96-e186706409dc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.603922 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a5672-16df-42da-bb96-e186706409dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.623193 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-075a5672-16df-42da-bb96-e186706409dc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:43.624638 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-075a5672-16df-42da-bb96-e186706409dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:43.638575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:43.643435 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1389/2786] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:43.648818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bdb03-98fb-4ef9-9a18-670c9aa826df None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.653702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.659765 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:43.673228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1398/2787] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:16:43.674929 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a5672-16df-42da-bb96-e186706409dc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:43.684020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a5672-16df-42da-bb96-e186706409dc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.689282 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.689878 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.690661 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.690955 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.691632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.693558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:43.801949 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1390/2788] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:43 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:43.806023 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:43.816419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8fa1-2f73-4b0d-8b3a-392cb56cc118 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.872149 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.872817 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.873101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.873378 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.874100 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.876226 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:43.969327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1399/2789] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:43 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:43.976377 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:43.986511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d3245-7821-4bcd-93ef-97921e4ffc3c admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:43.991410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:43.992072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:43.992355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:43.992635 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:43.993358 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:43.994994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.006208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1391/2790] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:44.013629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.024352 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9bf7-64c0-4925-974a-e03d1356f68b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.029601 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.030251 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.030529 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.030899 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.031578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.033147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede53ad5-9e23-434a-9103-5f5a297e2efd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.043385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1400/2791] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:44.048475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.058962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb667-97a1-4c60-944f-3b90cac213f2 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.063456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.064309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.064586 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.064857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] PATH_INFO: `/v3/projects/405969b7f4054a2bbe38f3d54bba430c/users/f48037e7044c47d9bdedaaa62d35ebcb/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.079950 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] RBAC: Authorizing `identity:create_grant(project_id=405969b7f4054a2bbe38f3d54bba430c, user_id=f48037e7044c47d9bdedaaa62d35ebcb, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.082732 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.154089 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1392/2792] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:44 2022] PUT /identity/v3/projects/405969b7f4054a2bbe38f3d54bba430c/users/f48037e7044c47d9bdedaaa62d35ebcb/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:44.164563 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.164858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.165156 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.191926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] MFA Rules not processed for user `f48037e7044c47d9bdedaaa62d35ebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:44.193117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:44.253897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1401/2793] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:44.258390 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.317923 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5fdfe-ddd6-415c-b2d5-c4e59c3a706d admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.322417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.323065 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.323346 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.323619 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.324294 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.326228 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.424219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1393/2794] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:44 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:44.428903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.439406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025784e4-1c42-44df-b3c8-5e2e011b6c80 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.492823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.493509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.493795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.494069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.494747 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.496652 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.595046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1402/2795] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:44 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:44.599196 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.609418 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5b89f-5cc8-4d70-a768-95cfae82b871 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.614359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.615016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.615301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.615599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.616337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.617966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.629067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1394/2796] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:44.634171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.643054 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc995-7e4a-43a7-9e8b-70261aa8a47d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.648360 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.649222 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.649535 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.649815 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] PATH_INFO: `/v3/projects/7b355a8fd3d846f8b7230cb4502d288d/users/2de86d0c25d0495bb117b0d703c4bda3/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.665650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b355a8fd3d846f8b7230cb4502d288d, user_id=2de86d0c25d0495bb117b0d703c4bda3, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.668303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f2bc-b801-402a-bf8e-dee1927e6a42 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.743391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1403/2797] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:44 2022] PUT /identity/v3/projects/7b355a8fd3d846f8b7230cb4502d288d/users/2de86d0c25d0495bb117b0d703c4bda3/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:44.744569 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.756165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb697-4195-47cb-8cf5-a39adb94a79e admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.761891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72637b6-5d37-4098-9227-b43abf2aefaa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.762181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72637b6-5d37-4098-9227-b43abf2aefaa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.762501 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72637b6-5d37-4098-9227-b43abf2aefaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.780024 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b72637b6-5d37-4098-9227-b43abf2aefaa None None] MFA Rules not processed for user `2f636f22e2a5414dbc455b74e509f529`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:44.781257 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b72637b6-5d37-4098-9227-b43abf2aefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:44.815607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.816268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.816546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.816819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.817577 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.819333 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.829020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1395/2798] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:44.833582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.835711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1404/2799] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 06:16:44.844343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d5678-321b-4052-be38-d30f2840d55a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:44.849861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:44.850776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.851108 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.851383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] PATH_INFO: `/v3/projects/7b355a8fd3d846f8b7230cb4502d288d/users/2de86d0c25d0495bb117b0d703c4bda3/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.853713 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b355a8fd3d846f8b7230cb4502d288d, user_id=2de86d0c25d0495bb117b0d703c4bda3, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:44.857938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:44.867159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1396/2800] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:44 2022] PUT /identity/v3/projects/7b355a8fd3d846f8b7230cb4502d288d/users/2de86d0c25d0495bb117b0d703c4bda3/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:44.878627 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:44.878950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:44.879211 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:44.906638 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] MFA Rules not processed for user `2de86d0c25d0495bb117b0d703c4bda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:44.907891 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:44.977823 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1405/2801] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:44.989373 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:44.991406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:45.053120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c34b-c557-4dc4-a5e2-67b5687e5ec0 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:45.056913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:45.057591 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:45.057877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:45.058152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:45.067853 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:45.069290 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:45.078902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1397/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:16:45.176468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:45.186085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743107e-9de7-497e-8de6-8e1cde1dbb8c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:45.193099 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:45.193856 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:45.194145 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:45.194424 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:45.251259 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:45.252719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c254045-c30d-4c3e-bb4b-56c2adc28c58 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:45.262910 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1406/2803] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:49.474432 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:49.535784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69a46-77fc-4d73-9508-20147a8603bb service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:49.540198 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:49.541056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:49.541334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:49.541637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] PATH_INFO: `/v3/users/f48037e7044c47d9bdedaaa62d35ebcb` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:49.542946 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48037e7044c47d9bdedaaa62d35ebcb)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:49.544857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:49.723584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48037e7044c47d9bdedaaa62d35ebcb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:49.809008 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48037e7044c47d9bdedaaa62d35ebcb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:49.821321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48037e7044c47d9bdedaaa62d35ebcb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:49.821995 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48037e7044c47d9bdedaaa62d35ebcb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:49.822739 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48037e7044c47d9bdedaaa62d35ebcb'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:49.835125 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1398/2804] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:49 2022] DELETE /identity/v3/users/f48037e7044c47d9bdedaaa62d35ebcb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:49.841756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:49.841756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:49.841756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:49.874681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:49.874681 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:49.934780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1407/2805] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:49.945610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:49.947029 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:50.009563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b9fd-8845-4b18-a2ef-fef2e30e7110 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:50.013328 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:50.014003 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:50.014406 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:50.014684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:50.024558 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:50.026060 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:50.036588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1399/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:50.484698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:50.486131 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:50.500303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7908a-9509-4a45-b4b4-07820bf42442 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:50.502912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:50.504045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:50.504325 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:50.504617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] PATH_INFO: `/v3/projects/405969b7f4054a2bbe38f3d54bba430c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:50.505827 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405969b7f4054a2bbe38f3d54bba430c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:50.507717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:50.631784 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405969b7f4054a2bbe38f3d54bba430c', 'request_id': 'req-51e72917-73a7-4b6e-98c0-dec4c30bf647'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:50.637921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405969b7f4054a2bbe38f3d54bba430c', 'request_id': 'req-51e72917-73a7-4b6e-98c0-dec4c30bf647'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:50.643208 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405969b7f4054a2bbe38f3d54bba430c', 'request_id': 'req-51e72917-73a7-4b6e-98c0-dec4c30bf647'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:50.728128 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] The token cache is being invalidate because project 405969b7f4054a2bbe38f3d54bba430c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:50.728413 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:50.729027 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:50.730632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1408/2807] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:50 2022] DELETE /identity/v3/projects/405969b7f4054a2bbe38f3d54bba430c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:50.734671 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:50.745086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a55c6-f3e7-4ed1-af6b-1f92a66924d5 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:50.798300 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:50.799150 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:50.799427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:50.799700 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] PATH_INFO: `/v3/users/2de86d0c25d0495bb117b0d703c4bda3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:50.800883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de86d0c25d0495bb117b0d703c4bda3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:50.802808 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:50.990493 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de86d0c25d0495bb117b0d703c4bda3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.083201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de86d0c25d0495bb117b0d703c4bda3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.096170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de86d0c25d0495bb117b0d703c4bda3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.096859 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de86d0c25d0495bb117b0d703c4bda3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.097494 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-70edd262-4d21-417d-b9e2-882091895b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de86d0c25d0495bb117b0d703c4bda3'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.110313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1400/2808] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:16:50 2022] DELETE /identity/v3/users/2de86d0c25d0495bb117b0d703c4bda3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:51.570426 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:51.571882 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:51.585232 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e72917-73a7-4b6e-98c0-dec4c30bf647 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:51.639339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:51.642224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:51.642224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:51.642224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] PATH_INFO: `/v3/projects/7b355a8fd3d846f8b7230cb4502d288d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:51.642224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b355a8fd3d846f8b7230cb4502d288d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:51.643775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:51.819717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b355a8fd3d846f8b7230cb4502d288d', 'request_id': 'req-22543250-6537-4ded-9489-8bc7f4ef4d99'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.825832 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b355a8fd3d846f8b7230cb4502d288d', 'request_id': 'req-22543250-6537-4ded-9489-8bc7f4ef4d99'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.831264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b355a8fd3d846f8b7230cb4502d288d', 'request_id': 'req-22543250-6537-4ded-9489-8bc7f4ef4d99'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.934252 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] The token cache is being invalidate because project 7b355a8fd3d846f8b7230cb4502d288d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:16:51.934536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.935161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22543250-6537-4ded-9489-8bc7f4ef4d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:16:51.936729 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1409/2809] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:16:51 2022] DELETE /identity/v3/projects/7b355a8fd3d846f8b7230cb4502d288d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:51.942213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:51.944156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:51.944156 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:51.960865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:51.962127 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:52.019152 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1401/2810] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:52.027564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.027880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.028158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.046313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:52.047536 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:52.055657 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1410/2811] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:52.059684 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.069871 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce460ea3-34c0-403a-b489-5868c0cf024f None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.074447 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.075090 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.075682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.075682 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.076347 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:16:52.076655 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.078277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.090331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1402/2812] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:16:52.094708 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.103958 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12f95-8224-428f-bd27-0a654edb6f47 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.108806 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.109617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.109924 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.110209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.110912 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.112872 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.207812 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1411/2813] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:52.211931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.221673 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68c98-2030-47e0-8f1d-2290adba4d9a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.275476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.276124 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.276402 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.276676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.277352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.279380 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.385697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1403/2814] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:16:52.389904 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.400750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd904-5057-44ad-9479-5f243c8b18ab admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.406468 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.407185 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.407471 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.407895 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.408626 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.410326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.421046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1412/2815] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:52.425015 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.436252 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67af37-635f-4646-9755-537b68a532d9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.441154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.442475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.442762 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.443112 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.443843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.445757 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953ffc4-c28b-4ae2-b3cb-80ec797b0d9c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.455896 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1404/2816] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:52.460162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.473137 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48622d-f66f-4d4f-a83c-6409734b24eb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.477724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.478591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.478871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.479147 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] PATH_INFO: `/v3/projects/bf221c8a310746d593eb0389c02e1117/users/e436b919f47e4d968af84afac5415f0b/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.494120 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf221c8a310746d593eb0389c02e1117, user_id=e436b919f47e4d968af84afac5415f0b, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.496873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.601104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1413/2817] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:52 2022] PUT /identity/v3/projects/bf221c8a310746d593eb0389c02e1117/users/e436b919f47e4d968af84afac5415f0b/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:52.611525 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.611812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.612086 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.639054 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] MFA Rules not processed for user `e436b919f47e4d968af84afac5415f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:52.640239 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:52.701675 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1405/2818] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:52.706218 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.766447 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f69b18-59f5-491b-acaf-65a88d73b290 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.771944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.772593 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.772871 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.773146 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.773865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.775764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:52.858883 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1414/2819] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:52.863032 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:52.874137 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46589e9-0a89-4952-8b2c-ee8c2465ac64 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:52.928064 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:52.928650 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:52.928931 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:52.929201 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:52.929924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:52.931837 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.011362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1406/2820] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:52 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:53.015417 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.026041 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20df296-e1bb-4bab-9e20-b9d4531a495b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.030930 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.031583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.031866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.032141 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.032860 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.034491 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.044897 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1415/2821] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:53.048759 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.058466 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123976a4-e3b0-4773-9c14-aeb8295e17b5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.063071 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.063707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.064164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.064445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.065181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.066824 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c958394-2a53-4e32-94bd-285e29b8237a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.076676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1407/2822] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:53.080668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.090668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3ea3-2c9a-43a6-b496-5cf14d5a1619 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.095177 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.096028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.096306 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.096575 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] PATH_INFO: `/v3/projects/e38476f4db4041d0baff1d266e230d02/users/5bdd33595c4e4757bf4fbb259497c055/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.111432 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38476f4db4041d0baff1d266e230d02, user_id=5bdd33595c4e4757bf4fbb259497c055, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.114165 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.210083 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1416/2823] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:53 2022] PUT /identity/v3/projects/e38476f4db4041d0baff1d266e230d02/users/5bdd33595c4e4757bf4fbb259497c055/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:53.221242 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.221697 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.222017 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.249173 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] MFA Rules not processed for user `5bdd33595c4e4757bf4fbb259497c055`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:53.250384 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:53.311787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1408/2824] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:53.316303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.376419 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7ac0-c4cd-4a8a-92d3-8d2c52da4afe admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.381902 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.382557 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.382838 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.383114 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.383808 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.385711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.472683 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1417/2825] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:16:53 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:53.476478 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.486787 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270c80-656b-44bc-98e3-f31579ab1cf2 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.541323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.542020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.542305 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.542579 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.543258 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.545180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.627020 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1409/2826] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:16:53 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:16:53.631781 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.642371 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e3e1-5072-4872-afd4-60aacf4cdd30 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.647981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.648632 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.648915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.649193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.649949 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.654547 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.662037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1418/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:53.666115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.675983 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609877c-9b6f-4ad5-8902-634b80743258 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.680546 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.683323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.683323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.683323 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] PATH_INFO: `/v3/projects/c94594fea6ba494788951e055bab01b3/users/f4477faf86854907b20aba85700c1c90/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.697637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94594fea6ba494788951e055bab01b3, user_id=f4477faf86854907b20aba85700c1c90, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.700437 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.798214 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1410/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:53 2022] PUT /identity/v3/projects/c94594fea6ba494788951e055bab01b3/users/f4477faf86854907b20aba85700c1c90/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:16:53.802583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.812933 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9484f-5dfc-425c-adc4-afc884533045 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.868102 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.868761 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.869045 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.869316 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.870068 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.871691 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cf194-eda5-4549-b9f4-95a3ee9956b1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.882440 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1419/2829] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:16:53.886707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:53.897114 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7005f-244d-4e03-b998-6dd3453628ac admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:53.901751 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:53.902701 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.902976 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.903331 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] PATH_INFO: `/v3/projects/c94594fea6ba494788951e055bab01b3/users/f4477faf86854907b20aba85700c1c90/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.905268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94594fea6ba494788951e055bab01b3, user_id=f4477faf86854907b20aba85700c1c90, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:53.907981 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:53.918599 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1411/2830] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:16:53 2022] PUT /identity/v3/projects/c94594fea6ba494788951e055bab01b3/users/f4477faf86854907b20aba85700c1c90/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:16:53.929116 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:53.929996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:53.930359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:53.958015 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] MFA Rules not processed for user `f4477faf86854907b20aba85700c1c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:16:53.961250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:54.036975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1420/2831] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:16:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:16:54.044799 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:54.046677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:16:54.102131 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab4d92-96cd-4fd7-8033-846410110d59 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:54.106147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:54.106791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:54.107067 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:54.107337 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:54.164281 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:54.165779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:54.174758 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1412/2832] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:56.277746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:56.288091 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdb9ae-dfc6-4a4f-939b-1aefc0e3dd73 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:56.291803 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:56.292442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:56.292842 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:56.293127 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:56.351228 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:56.352675 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:56.361969 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1421/2833] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:16:57.819342 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:16:57.830825 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abe37-b111-4679-bec2-2004994efcbb service cinder] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:16:57.834705 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:16:57.838394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:16:57.838394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:16:57.838394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:16:57.866578 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:16:57.872776 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf0d0-486d-4de6-afdf-717cd48285f9 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:16:57.877487 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1413/2834] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:16:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:02.690396 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:02.786881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a3f29-c1b4-43a4-be8d-42ce63c2f341 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:02.791382 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:02.792243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:02.792525 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:02.792799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] PATH_INFO: `/v3/users/e436b919f47e4d968af84afac5415f0b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:02.794019 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e436b919f47e4d968af84afac5415f0b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:02.795926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:03.032126 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e436b919f47e4d968af84afac5415f0b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.172408 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e436b919f47e4d968af84afac5415f0b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.184975 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e436b919f47e4d968af84afac5415f0b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.185620 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e436b919f47e4d968af84afac5415f0b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.192058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e436b919f47e4d968af84afac5415f0b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.198150 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1422/2835] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:17:02 2022] DELETE /identity/v3/users/e436b919f47e4d968af84afac5415f0b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:03.202605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:03.203091 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:03.203284 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:03.251576 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:03.252793 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:03.309185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1414/2836] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:03.318913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:03.320290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:03.414395 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89239df-5a2d-4ad3-8397-f3c8e399bc6d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:03.418123 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:03.418759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:03.419037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:03.419310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:03.428202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:03.429690 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:03.438818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1423/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:03.835072 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:03.836562 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:03.849609 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5e4e3-a69c-43a3-af7a-1c61d089a824 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:03.854205 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:03.855066 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:03.855366 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:03.855941 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] PATH_INFO: `/v3/projects/bf221c8a310746d593eb0389c02e1117` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:03.857389 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf221c8a310746d593eb0389c02e1117)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:03.859399 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:03.959107 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf221c8a310746d593eb0389c02e1117', 'request_id': 'req-ee3dba03-9195-47b8-9398-b6de820e3d11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.965369 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf221c8a310746d593eb0389c02e1117', 'request_id': 'req-ee3dba03-9195-47b8-9398-b6de820e3d11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:03.971103 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf221c8a310746d593eb0389c02e1117', 'request_id': 'req-ee3dba03-9195-47b8-9398-b6de820e3d11'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.037606 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] The token cache is being invalidate because project bf221c8a310746d593eb0389c02e1117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:17:04.037903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.038605 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.043479 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1415/2838] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:17:03 2022] DELETE /identity/v3/projects/bf221c8a310746d593eb0389c02e1117 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:04.044266 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:04.053742 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353c9c-5a01-4921-a1ea-7da64cf1143f service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:04.110865 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:04.111721 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:04.112687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:04.112687 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] PATH_INFO: `/v3/users/5bdd33595c4e4757bf4fbb259497c055` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:04.113735 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdd33595c4e4757bf4fbb259497c055)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:04.115654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:04.327658 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdd33595c4e4757bf4fbb259497c055'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.401194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdd33595c4e4757bf4fbb259497c055'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.414101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdd33595c4e4757bf4fbb259497c055'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.415073 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdd33595c4e4757bf4fbb259497c055'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.422162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdd33595c4e4757bf4fbb259497c055'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:04.428608 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1424/2839] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:17:04 2022] DELETE /identity/v3/users/5bdd33595c4e4757bf4fbb259497c055 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:04.841812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:04.843816 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:04.868207 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dba03-9195-47b8-9398-b6de820e3d11 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:04.930428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:04.931905 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:04.932185 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:04.932475 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] PATH_INFO: `/v3/projects/e38476f4db4041d0baff1d266e230d02` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:04.933678 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38476f4db4041d0baff1d266e230d02)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:04.935565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:05.102544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38476f4db4041d0baff1d266e230d02', 'request_id': 'req-014bfe33-38ea-492f-8db5-2710b419a392'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.109164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38476f4db4041d0baff1d266e230d02', 'request_id': 'req-014bfe33-38ea-492f-8db5-2710b419a392'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.113909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38476f4db4041d0baff1d266e230d02', 'request_id': 'req-014bfe33-38ea-492f-8db5-2710b419a392'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.200367 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] The token cache is being invalidate because project e38476f4db4041d0baff1d266e230d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:17:05.200647 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.201268 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.202843 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1416/2840] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:17:04 2022] DELETE /identity/v3/projects/e38476f4db4041d0baff1d266e230d02 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:05.206952 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:05.208835 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:05.221327 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542d23-0cde-4a44-873a-ec9b84c5d922 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:05.280968 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:05.281944 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:05.282798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:05.282798 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] PATH_INFO: `/v3/users/f4477faf86854907b20aba85700c1c90` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:05.283932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4477faf86854907b20aba85700c1c90)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:05.286533 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:05.487339 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4477faf86854907b20aba85700c1c90'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.540973 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4477faf86854907b20aba85700c1c90'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.553560 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4477faf86854907b20aba85700c1c90'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.554269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4477faf86854907b20aba85700c1c90'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.560915 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9fdb157e-6559-4443-ab1a-319be727c3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4477faf86854907b20aba85700c1c90'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:05.567457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1425/2841] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:17:05 2022] DELETE /identity/v3/users/f4477faf86854907b20aba85700c1c90 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:06.042907 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.044423 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:06.058468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfe33-38ea-492f-8db5-2710b419a392 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.116917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.117803 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.118083 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.118355 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] PATH_INFO: `/v3/projects/c94594fea6ba494788951e055bab01b3` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.119550 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94594fea6ba494788951e055bab01b3)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.121465 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.218640 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94594fea6ba494788951e055bab01b3', 'request_id': 'req-e98e9931-2a63-4971-a250-666111daf473'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:06.225348 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94594fea6ba494788951e055bab01b3', 'request_id': 'req-e98e9931-2a63-4971-a250-666111daf473'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:06.230733 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94594fea6ba494788951e055bab01b3', 'request_id': 'req-e98e9931-2a63-4971-a250-666111daf473'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:06.304275 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] The token cache is being invalidate because project c94594fea6ba494788951e055bab01b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:17:06.304560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:06.305172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-e98e9931-2a63-4971-a250-666111daf473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:06.306775 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1417/2842] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:17:06 2022] DELETE /identity/v3/projects/c94594fea6ba494788951e055bab01b3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:06.312498 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.312981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.313098 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.361350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:06.362918 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:06.423528 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1426/2843] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:06.495428 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.495627 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.495894 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.514481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:06.515652 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:06.523344 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1418/2844] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:06.527409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.536964 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba8fa-51b0-4624-bcb2-0605a0eb0a4b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.541534 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.542180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.542464 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.542740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.543457 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:17:06.543787 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.545379 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.558243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1427/2845] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:17:06.562548 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.572213 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ee6f-8b6e-4046-9726-b221e4bfa2bf None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.576827 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.577495 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.577778 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.578048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.578726 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.580610 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.697670 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1419/2846] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:17:06 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:17:06.701961 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.711986 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce54a4c-89e4-4343-aca6-27ebc903076a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.768309 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.768893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.769173 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.769466 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.770158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.772071 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.841668 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1428/2847] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:17:06 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:17:06.846011 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.857329 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf17b-1a20-4424-81f0-d603421ad078 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.862212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.862865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.863146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.863422 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.864781 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.866417 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.876973 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1420/2848] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:17:06.881321 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.891422 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e7cc-d30e-4056-bb1a-2a211e3e684a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.895947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.901209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.901209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.901209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.901209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.901209 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0e50a-805d-45c4-b622-898a41ed5a2e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:06.910162 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1429/2849] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:17:06.915037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:06.925037 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eb8f-c143-4ab7-baca-3de6e3a7a9a1 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:06.930696 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:06.931600 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:06.935561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:06.935561 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] PATH_INFO: `/v3/projects/62bf8fa5253543b898dabcc9ff27aafe/users/6098fd9902794068a7df83792180af19/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:06.947084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bf8fa5253543b898dabcc9ff27aafe, user_id=6098fd9902794068a7df83792180af19, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:06.949804 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:07.023386 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1421/2850] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:17:06 2022] PUT /identity/v3/projects/62bf8fa5253543b898dabcc9ff27aafe/users/6098fd9902794068a7df83792180af19/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:07.032423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:07.032717 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:07.032990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:07.060942 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] MFA Rules not processed for user `6098fd9902794068a7df83792180af19`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:07.062313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:07.128711 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1430/2851] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:07.140056 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:07.141777 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:07.196516 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c2b55-fe9b-4544-8c5c-f719844cddbe admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:07.200307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b52b24c45b04205922a4394f8eddea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:07.200940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:07.201336 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:07.201648 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:07.210736 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:07.212169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f1728-d271-45a9-848f-202a4f1f71c5 service cinder] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:07.221520 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1422/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:11.323576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:11.384527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8160f4-92ca-4179-b402-ec165c343bf2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:11.389004 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:11.389888 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:11.390171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:11.390444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] PATH_INFO: `/v3/users/6098fd9902794068a7df83792180af19` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:11.391799 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6098fd9902794068a7df83792180af19)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:11.393837 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:11.570046 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6098fd9902794068a7df83792180af19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:11.641381 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6098fd9902794068a7df83792180af19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:11.654699 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6098fd9902794068a7df83792180af19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:11.655425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6098fd9902794068a7df83792180af19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:11.662356 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6098fd9902794068a7df83792180af19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:11.668112 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1431/2853] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:17:11 2022] DELETE /identity/v3/users/6098fd9902794068a7df83792180af19 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:11.672830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:11.673319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:11.673421 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:11.689928 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:11.691115 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:11.750420 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1423/2854] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:11.760852 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:11.762264 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:11.820442 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ce81e-7d68-4266-9438-1238b192bd93 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:11.824039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:11.824673 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:11.824956 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:11.825230 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:11.834062 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:11.835496 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:11.844744 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1432/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:12.272988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:12.274492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:12.287511 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448bdd-7a42-4674-95fd-b2e6380b8bf6 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:12.292508 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:12.293753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:12.293753 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:12.294016 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] PATH_INFO: `/v3/projects/62bf8fa5253543b898dabcc9ff27aafe` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:12.295394 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bf8fa5253543b898dabcc9ff27aafe)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:12.297351 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:12.401634 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bf8fa5253543b898dabcc9ff27aafe', 'request_id': 'req-a0409e76-15db-4c9e-9c08-0a791544c023'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:12.407873 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bf8fa5253543b898dabcc9ff27aafe', 'request_id': 'req-a0409e76-15db-4c9e-9c08-0a791544c023'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:12.413750 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bf8fa5253543b898dabcc9ff27aafe', 'request_id': 'req-a0409e76-15db-4c9e-9c08-0a791544c023'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:12.509885 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] The token cache is being invalidate because project 62bf8fa5253543b898dabcc9ff27aafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:17:12.510202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:12.510818 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:12.512359 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1424/2856] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:17:12 2022] DELETE /identity/v3/projects/62bf8fa5253543b898dabcc9ff27aafe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:25.646227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:25.647598 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:25.733505 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2707f-39a7-49db-a0d5-63221b728679 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:25.788913 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:25.789576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:25.789861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:25.790136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:25.792390 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:25.803170 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:25.804730 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:25.815069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1433/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:38.157182 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:38.158838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:38.223075 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409e76-15db-4c9e-9c08-0a791544c023 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:38.227829 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:38.228789 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:38.229170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:38.229467 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] PATH_INFO: `/v3/users/c79dc88dc1634ba5b51e1ca318f5439b` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:38.230687 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79dc88dc1634ba5b51e1ca318f5439b)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:38.232607 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:38.322850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:38.324357 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:38.409861 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31777d-79c1-43d1-a1ee-ccfa173428ff service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:38.415504 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:38.416171 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:38.416452 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:38.416726 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:38.418571 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:38.432415 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79dc88dc1634ba5b51e1ca318f5439b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:38.439932 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:38.441858 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f569b6-52a6-4838-9bc5-40c3b9af3157 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:38.454094 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1434/2858] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:38.511244 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79dc88dc1634ba5b51e1ca318f5439b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:38.524155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79dc88dc1634ba5b51e1ca318f5439b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:38.524870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79dc88dc1634ba5b51e1ca318f5439b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:38.525672 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79dc88dc1634ba5b51e1ca318f5439b'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:38.538219 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1425/2859] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:17:38 2022] DELETE /identity/v3/users/c79dc88dc1634ba5b51e1ca318f5439b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:17:38.543696 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:38.543991 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:38.544269 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:38.568243 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:17:38.569324 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:38.658178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1435/2860] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:17:38.668081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:38.669977 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:38.750427 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b7ac4-e091-4259-8ebb-11057c3fd18a admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:38.755272 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:38.756307 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:38.757481 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:38.757879 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:38.772613 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:38.774407 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:38.790237 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1426/2861] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:17:39.287480 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:17:39.288990 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:17:39.303044 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f9fc-522b-4eba-a275-a24021e1cdaa None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:17:39.310905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:17:39.311780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:17:39.312058 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:17:39.312336 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] PATH_INFO: `/v3/projects/501356946b964130b2ad7518f91a030c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:17:39.313679 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501356946b964130b2ad7518f91a030c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:17:39.315686 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:17:39.430136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501356946b964130b2ad7518f91a030c', 'request_id': 'req-41f83c3e-90bc-4955-9cc8-6f490825de77'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:39.437307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501356946b964130b2ad7518f91a030c', 'request_id': 'req-41f83c3e-90bc-4955-9cc8-6f490825de77'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:39.443184 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501356946b964130b2ad7518f91a030c', 'request_id': 'req-41f83c3e-90bc-4955-9cc8-6f490825de77'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:39.519240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] The token cache is being invalidate because project 501356946b964130b2ad7518f91a030c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:17:39.519527 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:39.520286 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:17:39.521926 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1436/2862] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:17:39 2022] DELETE /identity/v3/projects/501356946b964130b2ad7518f91a030c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:18:04.991924 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:05.000676 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7318-9f28-4ea0-a3bc-1a49c64a01af service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:05.048104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:05.048742 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:05.049043 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:05.049315 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:05.051098 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:05.112665 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:05.114139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:05.124046 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1427/2863] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:18:08.524750 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:08.530502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:08.603096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83c3e-90bc-4955-9cc8-6f490825de77 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:08.608034 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:08.608698 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:08.608981 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:08.609260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:08.611262 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:08.623278 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:08.624939 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:08.635079 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1437/2864] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:18:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:18:12.431847 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:12.433299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:12.445255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c4e27-7f4d-4006-81ea-c10a693ff7e0 service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:12.449952 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:12.450875 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:12.451154 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:12.451424 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] PATH_INFO: `/v3/users/93edd5588db648ae9d5be8f20f60d6e6` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:12.465370 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93edd5588db648ae9d5be8f20f60d6e6)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:12.467240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:12.681925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93edd5588db648ae9d5be8f20f60d6e6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:12.746352 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93edd5588db648ae9d5be8f20f60d6e6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:12.759002 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93edd5588db648ae9d5be8f20f60d6e6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:12.759695 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93edd5588db648ae9d5be8f20f60d6e6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:12.760872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93edd5588db648ae9d5be8f20f60d6e6'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:12.772913 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1428/2865] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:18:12 2022] DELETE /identity/v3/users/93edd5588db648ae9d5be8f20f60d6e6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:18:13.031564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:13.043576 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd641e79-2e7b-4b69-b8f8-c84572f59e66 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:13.097724 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:13.098573 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:13.098850 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:13.099121 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] PATH_INFO: `/v3/projects/ac193dba6f144099ab5e70bc38c8c0a0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:13.109296 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac193dba6f144099ab5e70bc38c8c0a0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:13.111270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:13.214201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac193dba6f144099ab5e70bc38c8c0a0', 'request_id': 'req-03e80a04-105a-4fa8-88cd-78f62de1ab67'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.220921 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac193dba6f144099ab5e70bc38c8c0a0', 'request_id': 'req-03e80a04-105a-4fa8-88cd-78f62de1ab67'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.226313 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac193dba6f144099ab5e70bc38c8c0a0', 'request_id': 'req-03e80a04-105a-4fa8-88cd-78f62de1ab67'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.289391 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] The token cache is being invalidate because project ac193dba6f144099ab5e70bc38c8c0a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:18:13.289893 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.290710 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.292409 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1438/2866] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:18:13 2022] DELETE /identity/v3/projects/ac193dba6f144099ab5e70bc38c8c0a0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:18:13.296476 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:13.300631 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:13.314277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca5c1e-46f1-4d14-a42b-5651408a4a81 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:13.374788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:13.375658 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:13.375938 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:13.376210 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] PATH_INFO: `/v3/users/3ff6b43dc77f4842b44bd7e1a55a9f97` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:13.391630 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff6b43dc77f4842b44bd7e1a55a9f97)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:13.393641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:13.598521 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff6b43dc77f4842b44bd7e1a55a9f97'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.688881 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff6b43dc77f4842b44bd7e1a55a9f97'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.700685 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff6b43dc77f4842b44bd7e1a55a9f97'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.701321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff6b43dc77f4842b44bd7e1a55a9f97'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.701962 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bdad32e3-f6cd-41ff-86a4-28499e0fe1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff6b43dc77f4842b44bd7e1a55a9f97'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:13.713601 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1429/2867] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:18:13 2022] DELETE /identity/v3/users/3ff6b43dc77f4842b44bd7e1a55a9f97 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:18:13.940181 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:13.942101 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:13.954977 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e80a04-105a-4fa8-88cd-78f62de1ab67 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:14.012193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:14.013053 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:14.013328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:14.013629 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] PATH_INFO: `/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:14.024161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f51c354a0dd43cdb23ab619e5ce643c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:14.026670 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:14.167256 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f51c354a0dd43cdb23ab619e5ce643c', 'request_id': 'req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:14.173925 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f51c354a0dd43cdb23ab619e5ce643c', 'request_id': 'req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:14.179193 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f51c354a0dd43cdb23ab619e5ce643c', 'request_id': 'req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:14.251040 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] The token cache is being invalidate because project 2f51c354a0dd43cdb23ab619e5ce643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:18:14.251328 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:14.251945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:18:14.253513 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1439/2868] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:18:13 2022] DELETE /identity/v3/projects/2f51c354a0dd43cdb23ab619e5ce643c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:18:25.290865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:25.291383 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:25.291477 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:25.308882 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] MFA Rules not processed for user `2f636f22e2a5414dbc455b74e509f529`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:18:25.310094 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:25.364240 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1430/2869] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:18:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:18:58.642920 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:18:58.644318 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:58.699996 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b148f4-d1fb-452f-b04a-ce9be0f2ab8f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:18:58.703587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:18:58.704219 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:18:58.704497 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:18:58.704770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:18:58.706514 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:18:58.763084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:18:58.764519 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:18:58.773334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1440/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:19:05.064966 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:05.066473 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:05.078603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b697-c1a3-4f64-889d-0487976f6636 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:05.082243 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:05.082935 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:05.083218 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:05.083492 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:05.085211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:05.148255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:05.149783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:05.160801 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1431/2871] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:19:12.201365 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:12.202905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:12.271725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e684-1c50-4219-b76a-585e6e5266e1 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:12.277423 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:12.278087 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:12.278370 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:12.278644 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:12.280406 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:12.292399 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:12.294077 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:12.307096 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1441/2872] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:19:12.310766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:12.310766 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:12.323815 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914e51-8242-415f-a6b0-1bd5e398992d service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:12.328677 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:12.329582 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:12.329867 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:12.330144 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] PATH_INFO: `/v3/users/c8a705b8ac9f40bfb35110ee2f61ac17` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:12.331343 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a705b8ac9f40bfb35110ee2f61ac17)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:12.333261 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:12.518123 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a705b8ac9f40bfb35110ee2f61ac17'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:12.584563 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a705b8ac9f40bfb35110ee2f61ac17'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:12.596514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a705b8ac9f40bfb35110ee2f61ac17'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:12.597165 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a705b8ac9f40bfb35110ee2f61ac17'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:12.597779 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a705b8ac9f40bfb35110ee2f61ac17'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:12.609319 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1432/2873] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:19:12 2022] DELETE /identity/v3/users/c8a705b8ac9f40bfb35110ee2f61ac17 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:12.839908 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:12.850502 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1a20-cf41-44e4-bea6-9467b2f2fd08 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:12.907994 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:12.913719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:12.913719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:12.913719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] PATH_INFO: `/v3/projects/dbc74906c6ae4a76b628ff3fa8cda00e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:12.913719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc74906c6ae4a76b628ff3fa8cda00e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:12.913719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:13.003310 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc74906c6ae4a76b628ff3fa8cda00e', 'request_id': 'req-fab2f790-c5b5-42cc-8353-0af0823aac6a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.009425 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc74906c6ae4a76b628ff3fa8cda00e', 'request_id': 'req-fab2f790-c5b5-42cc-8353-0af0823aac6a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.015637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc74906c6ae4a76b628ff3fa8cda00e', 'request_id': 'req-fab2f790-c5b5-42cc-8353-0af0823aac6a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.105672 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] The token cache is being invalidate because project dbc74906c6ae4a76b628ff3fa8cda00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:19:13.105874 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.106521 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.108069 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1442/2874] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:19:12 2022] DELETE /identity/v3/projects/dbc74906c6ae4a76b628ff3fa8cda00e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:13.112209 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:13.113668 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:13.127147 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f78cb-6342-4b23-bde2-a8dd9658fc57 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:13.180937 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:13.182468 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:13.182770 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:13.183048 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] PATH_INFO: `/v3/users/d465e9cc8a3d4aada169d89523e7022d` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:13.184253 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d465e9cc8a3d4aada169d89523e7022d)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:13.186208 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:13.330942 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd465e9cc8a3d4aada169d89523e7022d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.404181 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd465e9cc8a3d4aada169d89523e7022d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.416740 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd465e9cc8a3d4aada169d89523e7022d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.417374 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd465e9cc8a3d4aada169d89523e7022d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.418010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd465e9cc8a3d4aada169d89523e7022d'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.429786 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1433/2875] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:19:13 2022] DELETE /identity/v3/users/d465e9cc8a3d4aada169d89523e7022d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:13.668828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:13.675182 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:13.688492 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f790-c5b5-42cc-8353-0af0823aac6a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:13.743877 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:13.744759 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:13.745039 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:13.745312 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] PATH_INFO: `/v3/projects/12370ad0ad8f4c5eafa452545c053d78` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:13.746552 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12370ad0ad8f4c5eafa452545c053d78)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:13.748451 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:13.860578 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12370ad0ad8f4c5eafa452545c053d78', 'request_id': 'req-4f9224f2-94ab-4b2a-be51-91f5338fd677'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.866719 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12370ad0ad8f4c5eafa452545c053d78', 'request_id': 'req-4f9224f2-94ab-4b2a-be51-91f5338fd677'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.872064 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12370ad0ad8f4c5eafa452545c053d78', 'request_id': 'req-4f9224f2-94ab-4b2a-be51-91f5338fd677'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.944580 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] The token cache is being invalidate because project 12370ad0ad8f4c5eafa452545c053d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:19:13.944867 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.945647 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:13.947176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1443/2876] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:19:13 2022] DELETE /identity/v3/projects/12370ad0ad8f4c5eafa452545c053d78 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:35.237723 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:35.239526 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:35.253022 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7fa59-dc6a-4836-b752-134f1ccdc9e5 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:35.306979 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:35.319513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:35.319513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:35.319513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] PATH_INFO: `/v3/users/2f636f22e2a5414dbc455b74e509f529` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:35.319513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f636f22e2a5414dbc455b74e509f529)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:35.319513 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:35.489118 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f636f22e2a5414dbc455b74e509f529'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:35.578850 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f636f22e2a5414dbc455b74e509f529'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:35.590916 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f636f22e2a5414dbc455b74e509f529'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:35.591527 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f636f22e2a5414dbc455b74e509f529'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:35.592133 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-96f388b4-c976-432a-a835-1d9fff7fd217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f636f22e2a5414dbc455b74e509f529'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:35.604440 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1434/2877] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:19:35 2022] DELETE /identity/v3/users/2f636f22e2a5414dbc455b74e509f529 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:35.826654 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:35.828095 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:35.843035 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9224f2-94ab-4b2a-be51-91f5338fd677 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:35.900140 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:35.901623 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:35.901903 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:35.908236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] PATH_INFO: `/v3/projects/39d8e0e9d69d4e34bdef54a917228f74` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:35.908236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d8e0e9d69d4e34bdef54a917228f74)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:35.908236 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.029816 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d8e0e9d69d4e34bdef54a917228f74', 'request_id': 'req-32caaaf3-1b22-4b8b-915d-4074b7821684'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:36.035788 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d8e0e9d69d4e34bdef54a917228f74', 'request_id': 'req-32caaaf3-1b22-4b8b-915d-4074b7821684'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:36.040950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d8e0e9d69d4e34bdef54a917228f74', 'request_id': 'req-32caaaf3-1b22-4b8b-915d-4074b7821684'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:36.151795 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] The token cache is being invalidate because project 39d8e0e9d69d4e34bdef54a917228f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:19:36.152017 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:36.152640 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32caaaf3-1b22-4b8b-915d-4074b7821684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:19:36.154240 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1444/2878] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:19:35 2022] DELETE /identity/v3/projects/39d8e0e9d69d4e34bdef54a917228f74 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:36.159747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.159747 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.159980 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.178812 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:36.179994 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:36.235325 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1435/2879] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:36.243160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.243444 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.243739 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.262911 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:36.264085 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:36.271756 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1445/2880] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:36.275839 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.285019 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d581c-8c8f-4fd9-bfa7-7d7a93865bdc None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.289425 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.290084 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.290360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.290632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.291379 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 06:19:36.291680 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.293263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.304146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1436/2881] 10.222.0.26 () {58 vars in 1153 bytes} [Tue Aug 23 06:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 06:19:36.308840 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.317931 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599329-c0c4-4e05-a11a-0a8a659df7cc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.323301 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.323940 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.324224 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.324500 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.325194 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.327178 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.440702 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1446/2882] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 06:19:36.444669 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.454608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f74c3-a354-444f-b278-bd25baf4d6a4 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.508010 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.508664 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.508943 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.509212 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.509959 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.511860 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.584360 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1437/2883] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:19:36 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:19:36.588583 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.598905 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85681-0492-46df-99fe-6aa1422b300d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.604104 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.604749 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.605030 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.605308 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.606059 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.607665 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.619998 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1447/2884] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:19:36.623865 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.633846 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133feb-6185-45c7-9035-9fa7a1095f12 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.638857 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.639507 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.639788 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.640062 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] PATH_INFO: `/v3/roles` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.640832 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.642442 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449ae6-cd56-479e-966c-96a4f131385c admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.652211 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1438/2885] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:19:36.656303 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.666545 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4c01-5a27-4a7e-98a2-18740df0e8ac admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.671136 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.671993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.672271 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.672542 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] PATH_INFO: `/v3/projects/4e91d9c372c14fa6ab80d0c66b58e021/users/91b13969c62a46b6a3d61f0003a34716/roles/7b64cf89ada244d0a86bb5e4c176ed63` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.686945 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e91d9c372c14fa6ab80d0c66b58e021, user_id=91b13969c62a46b6a3d61f0003a34716, role_id=7b64cf89ada244d0a86bb5e4c176ed63)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.689625 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.789906 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1448/2886] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:19:36 2022] PUT /identity/v3/projects/4e91d9c372c14fa6ab80d0c66b58e021/users/91b13969c62a46b6a3d61f0003a34716/roles/7b64cf89ada244d0a86bb5e4c176ed63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 06:19:36.795529 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f05cb-e720-402e-8f1d-edecb72f17d6 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.795821 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f05cb-e720-402e-8f1d-edecb72f17d6 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.796102 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f05cb-e720-402e-8f1d-edecb72f17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.813334 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-388f05cb-e720-402e-8f1d-edecb72f17d6 None None] MFA Rules not processed for user `bc9a8d70ef924eccb0a2efd6a32909f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:36.814553 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-388f05cb-e720-402e-8f1d-edecb72f17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:36.869830 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1439/2887] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:36.882160 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:36.883889 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:36.939437 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96763-7b51-42ac-8ae4-b2b89c26b241 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:36.943117 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:36.943755 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:36.944037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:36.944314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:36.953263 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:36.954722 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:36.964584 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1449/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:19:41.702533 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:41.703202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:41.703202 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:41.747146 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] MFA Rules not processed for user `91b13969c62a46b6a3d61f0003a34716`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:41.749362 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:41.832925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1440/2889] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:41.837261 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:41.847180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70bb68-f1ed-47b3-b6fc-37bd0bbe7b19 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:41.851828 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:41.852509 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:41.852792 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:41.853066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:41.854287 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:41.856204 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:41.982201 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1450/2890] 10.222.0.26 () {60 vars in 1153 bytes} [Tue Aug 23 06:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:19:41.986309 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:41.998081 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330fc88-40c5-4f59-bb81-8db4a4d78e03 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:42.074573 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:42.074744 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:42.075027 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:42.075301 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] PATH_INFO: `/v3/users` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:42.075993 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:42.078007 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:42.187694 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1441/2891] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Aug 23 06:19:41 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 06:19:42.191676 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:42.202002 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265c090-88f3-42bb-9d43-44e72a693daf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:42.206587 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:42.207238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:42.207524 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:42.207801 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:42.208592 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:42.210479 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:42.221667 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1451/2892] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:19:42.225841 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:42.236277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf0bc3-09dc-44a2-87ff-21f080875a34 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:42.240974 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:42.241872 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:42.242155 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:42.242430 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] PATH_INFO: `/v3/projects/4733780d011e47b3a3975f151b07f97c/users/3ff5894a728a419ea22f9489c19a138a/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:42.256617 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4733780d011e47b3a3975f151b07f97c, user_id=3ff5894a728a419ea22f9489c19a138a, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:42.259313 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:42.336149 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1442/2893] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:19:42 2022] PUT /identity/v3/projects/4733780d011e47b3a3975f151b07f97c/users/3ff5894a728a419ea22f9489c19a138a/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:42.340709 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:42.355436 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931987-4b3c-480a-af09-dd78a4147a4e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:42.415275 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:42.415957 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:42.416238 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:42.416507 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:42.417216 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:42.418831 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cb36-d68e-47e3-8313-c074815b49a8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:42.428814 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1452/2894] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Aug 23 06:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 06:19:42.432854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:42.443194 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda0b37-7b91-4682-aad3-b36441d3f1cd admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:42.448295 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:42.449170 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:42.449474 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:42.449783 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] PATH_INFO: `/v3/projects/4733780d011e47b3a3975f151b07f97c/users/3ff5894a728a419ea22f9489c19a138a/roles/0b140cf23eea4013a92d34840813e9cf` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:42.451883 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4733780d011e47b3a3975f151b07f97c, user_id=3ff5894a728a419ea22f9489c19a138a, role_id=0b140cf23eea4013a92d34840813e9cf)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:42.454552 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:42.465594 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1443/2895] 10.222.0.26 () {60 vars in 1483 bytes} [Tue Aug 23 06:19:42 2022] PUT /identity/v3/projects/4733780d011e47b3a3975f151b07f97c/users/3ff5894a728a419ea22f9489c19a138a/roles/0b140cf23eea4013a92d34840813e9cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:19:47.908359 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56877d1-7be7-49a2-8d33-3fe39c735077 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:47.908846 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56877d1-7be7-49a2-8d33-3fe39c735077 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:47.908947 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56877d1-7be7-49a2-8d33-3fe39c735077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:47.937320 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b56877d1-7be7-49a2-8d33-3fe39c735077 None None] MFA Rules not processed for user `3ff5894a728a419ea22f9489c19a138a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:47.938564 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b56877d1-7be7-49a2-8d33-3fe39c735077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:48.024764 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1453/2896] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:48.039565 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:48.041940 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:48.135632 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596d5c6-9a54-4528-ae8a-79fd22030e94 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:48.139936 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:48.140903 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:48.141376 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:48.141877 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:48.204990 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:48.206637 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:48.217014 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1444/2897] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:19:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:19:48.442732 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d048f-0961-486c-aa83-8ed2fbfb6ed9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:48.443025 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d048f-0961-486c-aa83-8ed2fbfb6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:48.443307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d048f-0961-486c-aa83-8ed2fbfb6ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:48.502511 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c29d048f-0961-486c-aa83-8ed2fbfb6ed9 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:48.503818 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c29d048f-0961-486c-aa83-8ed2fbfb6ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:48.571866 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1454/2898] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:19:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:48.726588 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:48.728006 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:48.816854 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad344-42e3-4f3d-bb6d-891836c0a00e service glance] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:48.821944 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:48.823164 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:48.823445 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:48.823717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:48.832044 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:48.833681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:48.841608 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1445/2899] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:19:59.345346 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:59.348775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:59.348775 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:59.364786 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] MFA Rules not processed for user `91b13969c62a46b6a3d61f0003a34716`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:19:59.365993 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:59.373314 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1455/2900] 10.222.0.26 () {58 vars in 958 bytes} [Tue Aug 23 06:19:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:19:59.407603 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:19:59.416784 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bde509-7c12-46ab-b584-b77e76b23ba0 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:19:59.420286 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0d9910443224e84af4396d4b9af0656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:19:59.420904 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:19:59.421179 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:19:59.421456 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:19:59.423172 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:19:59.512584 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:19:59.514324 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186e12e-f6b6-4dd1-af67-9668a0608354 service glance] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:19:59.534660 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1446/2901] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:19:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:20:00.147119 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:20:00.200290 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b7d99-db29-4a15-a06e-40db18399368 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:20:00.206420 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:20:00.207028 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:20:00.207307 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:20:00.207581 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:20:00.209338 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:20:00.223350 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:20:00.224780 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:20:00.236070 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1456/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 06:20:02.862321 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] REQUEST_METHOD: `POST` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:20:02.862791 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:20:02.862888 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:20:02.880419 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.auth.core [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:20:02.881644 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:20:02.888984 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1447/2903] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Aug 23 06:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:20:02.905615 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:20:02.912774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfbe3-5e00-49e9-a2fe-3a0a5a04ecda service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:20:02.918247 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:20:02.918876 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:20:02.919158 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:20:02.919433 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:20:02.927376 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:20:02.928950 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:20:02.937635 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1457/2904] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:20:26.369057 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:20:26.378711 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed841b-4fcf-4d75-8c9e-0874662721e4 None None] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:20:26.382614 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:20:26.382909 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:20:26.383184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:20:26.383451 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:20:26.385231 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:20:26.395159 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:20:26.396560 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:20:26.405861 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1448/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:20:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:20:34.782774 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:20:34.784176 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:20:34.796463 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b527af-51fe-43ca-aaa2-4deda7f97014 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:20:34.799995 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064fd80565d543dfaca680bebfbb7127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:20:34.800617 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:20:34.800896 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:20:34.801174 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:20:34.810637 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:20:34.812050 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:20:34.821260 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1458/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:22:30.610622 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:22:30.611988 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:22:30.677278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f322e0e-5ceb-4d6c-8940-de8ee9368ade service neutron] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:22:30.682077 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:22:30.682707 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:22:30.682987 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:22:30.683263 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:22:30.684997 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:22:30.696502 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:22:30.698101 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:22:30.708180 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1449/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:22:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:22:54.110873 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:22:54.113011 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:22:54.131326 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ca8a-097f-49f1-bf1c-7d8c7c15715d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:22:54.137604 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:22:54.138740 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:22:54.139385 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:22:54.140066 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:22:54.142483 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:22:54.156537 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:22:54.159546 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0e644-525b-432e-b5c9-471828aa2cab service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:22:54.183844 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1459/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:22:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:22:55.762068 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:22:55.774982 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4755-3f8b-4c72-ac7d-6cf13b73d032 service placement] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:22:55.781045 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdab9833c3477b9c95fb011e629bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:22:55.781717 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:22:55.782001 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:22:55.782277 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:22:55.785166 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:22:55.799625 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:22:55.802852 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:22:55.813120 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1450/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:22:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:23:04.540770 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:04.541725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:04.541725 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:04.559881 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] MFA Rules not processed for user `0c909b1d772d4d58bf5965aceef1c908`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 06:23:04.561084 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:23:04.568300 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1460/2910] 10.222.0.26 () {58 vars in 967 bytes} [Tue Aug 23 06:23:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 06:23:04.609363 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:04.620537 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3751ff-17e0-4f3b-9f72-78aa2dfb23e5 service nova] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:04.625340 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe3c9bd5d944466b9b8d1fd3f904026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:04.625985 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:04.626265 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:04.626544 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:04.634255 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:04.635772 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:04.643699 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1451/2911] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Aug 23 06:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 06:23:08.991227 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:09.003746 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd734-54b7-49b8-9339-cbd1d74fd32e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:09.008864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5415-f439-4d97-8dda-86157862702c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:09.011489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5415-f439-4d97-8dda-86157862702c service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:09.011489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5415-f439-4d97-8dda-86157862702c service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:09.011489 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5415-f439-4d97-8dda-86157862702c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:09.012037 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-471c5415-f439-4d97-8dda-86157862702c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:23:09.024716 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c5415-f439-4d97-8dda-86157862702c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:09.026515 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c5415-f439-4d97-8dda-86157862702c service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:09.037241 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1461/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 06:23:12.438160 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:12.498646 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab08334-a830-433c-a301-0dea96197620 service swift] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:12.503454 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:12.504357 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:12.504641 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:12.504917 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] PATH_INFO: `/v3/users/91b13969c62a46b6a3d61f0003a34716` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:12.506184 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b13969c62a46b6a3d61f0003a34716)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:12.508140 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:12.649971 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b13969c62a46b6a3d61f0003a34716'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:12.722734 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b13969c62a46b6a3d61f0003a34716'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:12.734900 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b13969c62a46b6a3d61f0003a34716'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:12.735538 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b13969c62a46b6a3d61f0003a34716'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:12.736153 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b13969c62a46b6a3d61f0003a34716'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:12.748704 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1452/2913] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:23:12 2022] DELETE /identity/v3/users/91b13969c62a46b6a3d61f0003a34716 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:23:13.045516 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5415-f439-4d97-8dda-86157862702c service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:13.056161 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5415-f439-4d97-8dda-86157862702c service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:13.111651 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:13.112495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:13.112772 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:13.113043 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] PATH_INFO: `/v3/projects/4e91d9c372c14fa6ab80d0c66b58e021` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:13.114334 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e91d9c372c14fa6ab80d0c66b58e021)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:13.116270 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:13.225428 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e91d9c372c14fa6ab80d0c66b58e021', 'request_id': 'req-52225077-2369-42a7-b99f-ae462b4eed3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.231495 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e91d9c372c14fa6ab80d0c66b58e021', 'request_id': 'req-52225077-2369-42a7-b99f-ae462b4eed3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.236864 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e91d9c372c14fa6ab80d0c66b58e021', 'request_id': 'req-52225077-2369-42a7-b99f-ae462b4eed3b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.356394 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] The token cache is being invalidate because project 4e91d9c372c14fa6ab80d0c66b58e021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:23:13.356591 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.357202 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.358880 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1462/2914] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:23:13 2022] DELETE /identity/v3/projects/4e91d9c372c14fa6ab80d0c66b58e021 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:23:13.362870 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:13.367254 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:23:13.376925 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184925-a72c-4795-946b-787b56f07338 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:13.430514 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:13.431398 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:13.431681 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:13.431958 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] PATH_INFO: `/v3/users/3ff5894a728a419ea22f9489c19a138a` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:13.433138 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff5894a728a419ea22f9489c19a138a)` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:13.435104 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:13.625855 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff5894a728a419ea22f9489c19a138a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.716838 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff5894a728a419ea22f9489c19a138a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.728902 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff5894a728a419ea22f9489c19a138a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.729564 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff5894a728a419ea22f9489c19a138a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.730169 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.notifications [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff5894a728a419ea22f9489c19a138a'} {{(pid=80423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:13.742410 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1453/2915] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Aug 23 06:23:13 2022] DELETE /identity/v3/users/3ff5894a728a419ea22f9489c19a138a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:23:13.964669 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:23:13.966180 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:23:13.981250 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225077-2369-42a7-b99f-ae462b4eed3b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:23:14.035661 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9a8d70ef924eccb0a2efd6a32909f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3869decee235490cb9b23376a9ec23ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:23:14.037007 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:23:14.037283 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:23:14.037650 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] PATH_INFO: `/v3/projects/4733780d011e47b3a3975f151b07f97c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:23:14.038738 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4733780d011e47b3a3975f151b07f97c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:23:14.040671 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:23:14.128258 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4733780d011e47b3a3975f151b07f97c', 'request_id': 'req-6d2fc539-74d9-489f-974e-58dfb5e49afb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:14.134244 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4733780d011e47b3a3975f151b07f97c', 'request_id': 'req-6d2fc539-74d9-489f-974e-58dfb5e49afb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:14.139430 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4733780d011e47b3a3975f151b07f97c', 'request_id': 'req-6d2fc539-74d9-489f-974e-58dfb5e49afb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:14.218701 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] The token cache is being invalidate because project 4733780d011e47b3a3975f151b07f97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 06:23:14.223448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:14.223448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6d2fc539-74d9-489f-974e-58dfb5e49afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 06:23:14.223448 dv-cinder-853788-2-iscsi devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1463/2916] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Aug 23 06:23:13 2022] DELETE /identity/v3/projects/4733780d011e47b3a3975f151b07f97c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 06:27:33.625314 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Authenticating user token {{(pid=80423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 06:27:33.626745 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:27:33.761299 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b1fe-e7bc-43ee-8a60-3acc2c5f87e9 admin admin] Validating token access rules against request {{(pid=80423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 06:27:33.818178 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '655db89983b446278bc27381688d2f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f9654b0cd494e1b93f80ef04892bc23', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 06:27:33.818819 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] REQUEST_METHOD: `GET` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 06:27:33.819109 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] SCRIPT_NAME: `/identity` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 06:27:33.819385 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 06:27:33.821139 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.fernet_utils [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 06:27:33.832024 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 06:27:33.833643 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5702ea-039c-47c3-a1f5-53a810245d48 service placement] RBAC: Authorization granted {{(pid=80423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 06:27:33.843278 dv-cinder-853788-2-iscsi devstack@keystone.service[80423]: [pid: 80423|app: 0|req: 1454/2917] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Aug 23 06:27:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)